Nov 05 08:15:10 devstack cinder-volume[76044]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:15:10 devstack cinder-volume[76044]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:15:10 devstack cinder-volume[76044]: we strongly recommend against using it for new projects. Nov 05 08:15:10 devstack cinder-volume[76044]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:15:10 devstack cinder-volume[76044]: framework. For more detail see Nov 05 08:15:10 devstack cinder-volume[76044]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:15:10 devstack cinder-volume[76044]: import eventlet # noqa Nov 05 08:15:13 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:15:13 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:15:13 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:15:14 devstack cinder-volume[76044]: INFO dbcounter [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Registered counter for database cinder Nov 05 08:15:14 devstack cinder-volume[76044]: DEBUG oslo_db.sqlalchemy.engines [None req-6b018063-1e78-44df-addd-755061215eb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:14 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writer thread running {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:15:14 devstack cinder-volume[76044]: INFO cinder.rpc [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:15:14 devstack cinder-volume[76044]: INFO cinder.rpc [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:15:14 devstack cinder-volume[76044]: DEBUG oslo_db.sqlalchemy.engines [None req-6b018063-1e78-44df-addd-755061215eb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:15 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Determined volume DB was empty at startup. Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG cinder.volume.manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76044) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:15:15 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 08:15:15 devstack cinder-volume[76044]: WARNING stevedore.named [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:15:15 devstack cinder-volume[76044]: WARNING castellan.key_manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:15 devstack cinder-volume[76044]: WARNING cinder.keymgr.conf_key_mgr [None req-6b018063-1e78-44df-addd-755061215eb3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG cinder.volume.drivers.lvm [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76044) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_concurrency.processutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.433s {{(pid=76044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_db.sqlalchemy.engines [None req-6b018063-1e78-44df-addd-755061215eb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:15 devstack cinder-volume[76044]: INFO cinder.rpc [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 08:15:15 devstack cinder-volume[76044]: INFO cinder.rpc [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 08:15:15 devstack cinder-volume[76044]: WARNING stevedore.named [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:15:15 devstack cinder-volume[76044]: WARNING castellan.key_manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:15:15 devstack cinder-volume[76044]: INFO cinder.volume.manager [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_db.sqlalchemy.engines [None req-6b018063-1e78-44df-addd-755061215eb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:15 devstack cinder-volume[76044]: INFO oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Starting 1 workers Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Started child 76203 {{(pid=76044) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Full set of CONF: {{(pid=76044) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] ******************************************************************************** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Configuration options gathered from: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] ================================================================================ {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] allow_availability_zone_fallback = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] allow_compression_on_image_upload = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] allowed_direct_url_schemes = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] api_rate_limit = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] auth_strategy = keystone {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] az_cache_duration = 3600 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_availability_zone = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_host = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_stats_polling_interval = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backup_api_class = cinder.backup.api.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backup_name_template = backup-%s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backup_use_same_host = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backup_use_temp_snapshot = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] chap_password = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] chap_username = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_internal_tenant_project_id = 5a88b287820a4a3690ad674761a09d56 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_internal_tenant_user_id = ec34c71f731c473985fe40de274fb79e {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cloned_volume_same_az = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cluster = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] compression_format = gzip {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] compute_api_class = cinder.compute.nova.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] config_dir = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] config_source = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] control_exchange = openstack {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] debug = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] default_availability_zone = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] default_group_type = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] default_volume_type = lvmdriver-1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] disk_geometry = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_client_cert = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_client_cert_key = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_data_namespace = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_ssl_cert_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_ssl_cert_verify = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] driver_use_ssl = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] enable_force_upload = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] enable_new_services = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] enable_unsupported_driver = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] enforce_multipath_for_image_xfer = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] filter_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_api_insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_api_ssl_compression = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_ca_certificates_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_catalog_info = image:glance:publicURL {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_num_retries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance_request_timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] goodness_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] graceful_shutdown_timeout = 5 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] group_api_class = cinder.group.api.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] host = devstack {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_compress_on_upload = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_conversion_address_space_limit = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_conversion_cpu_limit = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_conversion_disable = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_introspection_address_space_limit = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_introspection_cpu_limit = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_upload_use_cinder_backend = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_upload_use_internal_tenant = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_volume_cache_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_volume_cache_max_count = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] image_volume_cache_max_size_gb = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] init_host_max_objects_retrieval = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] instance_format = [instance: %(uuid)s] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iscsi_target_flags = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iscsi_write_cache = on {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iser_helper = tgtadm {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iser_ip_address = 192.168.122.178 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iser_port = 3260 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_color = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_config_append = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_dir = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_options = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_rotate_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: INFO cinder.volume.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_rotate_interval_type = days {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] log_rotation_type = none {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] max_age = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] max_logfile_count = 30 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] max_logfile_size_mb = 200 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] max_over_subscription_ratio = 20.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] message_reap_interval = 86400 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] message_ttl = 2592000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] migration_create_volume_timeout_secs = 300 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] monkey_patch = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] monkey_patch_modules = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] my_ip = 192.168.122.178 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] no_snapshot_gb_quota = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] num_iser_scan_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] num_shell_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] num_volume_device_scan_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] nvmeof_conn_info_version = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] nvmet_ns_id = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] nvmet_port_id = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_max_limit = 1000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_ext_list = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_listen_port = 8776 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_use_ssl = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] osapi_volume_workers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] per_volume_size_limit = -1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] periodic_fuzzy_delay = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] periodic_interval = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] public_endpoint = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] publish_errors = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_backup_gigabytes = 1000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_backups = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_gigabytes = 1000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_groups = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_snapshots = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] quota_volumes = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] rate_limit_burst = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] rate_limit_except_level = CRITICAL {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] rate_limit_interval = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] reinit_driver_count = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] replication_device = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] report_discard_supported = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] report_interval = 120 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] reservation_clean_interval = 86400 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] reservation_expire = 86400 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] reserved_image_namespaces = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] reserved_percentage = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] rpc_response_timeout = 120 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] run_external_periodic_tasks = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] scst_target_driver = iscsi {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] scst_target_iqn_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_down_time = 720 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] shell_completion = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] snapshot_name_template = snapshot-%s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] snapshot_same_host = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] split_loggers = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] state_path = /opt/stack/data/cinder {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] storage_availability_zone = nova {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] storage_protocol = iSCSI {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] syslog_log_facility = LOG_USER {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_helper = lioadm {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_ip_address = 192.168.122.178 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_port = 3260 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_protocol = iscsi {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] target_secondary_ip_addresses = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] trace_flags = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] transport_url = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] until_refresh = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_chap_auth = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_default_quota_class = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_journal = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_json = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_multipath_for_image_xfer = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_stderr = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] use_syslog = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:15 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] verify_glance_signatures = enabled {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_api_class = cinder.volume.api.API {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_backend_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_clear = zero {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_clear_ionice = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_clear_size = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_copy_bps_limit = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_dd_blocksize = 1M {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_name_template = volume-%s {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_service_inithost_offload = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volume_usage_audit_period = month {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] zoning_mode = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_concurrency.disable_process_locking = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.auth_section = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.auth_type = password {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.auth_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.cache = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.include_service_catalog = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.interface = public {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_password = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack sudo[76207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack sudo[76207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcache_username = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.region_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.service_type = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.backend = dogpile.cache.null {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.backend_argument = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.backend_expiration_time = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.config_prefix = cache.oslo {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.debug_cache_backend = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.enable_retry_client = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.enable_socket_keepalive = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.expiration_time = 600 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.hashclient_retry_attempts = 2 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_dead_retry = 300 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_pool_maxsize = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_sasl_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.password = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.proxies = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.redis_db = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.redis_server = localhost:6379 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.retry_attempts = 2 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.retry_delay = 0.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.socket_keepalive_count = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.socket_keepalive_idle = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.socket_keepalive_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.socket_timeout = 1.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.tls_allowed_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.tls_cafile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.tls_certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.tls_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.tls_keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cache.username = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] coordination.backend_url = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.asyncio_connection = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.asyncio_slave_connection = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.backend = sqlalchemy {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.connection = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.connection_debug = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.connection_parameters = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.connection_recycle_time = 3600 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.connection_trace = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.db_inc_retry_interval = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.db_max_retries = 20 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.db_max_retry_interval = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.db_retry_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.max_overflow = 50 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.max_pool_size = 5 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.max_retries = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.mysql_wsrep_sync_wait = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.pool_timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.retry_interval = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.slave_connection = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.sqlite_synchronous = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.synchronous_reader = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] database.use_db_reconnect = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_tracing.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.connection_string = messaging:// {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.es_doc_type = notification {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.es_scroll_size = 10000 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.es_scroll_time = 2m {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.filter_error_trace = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.hmac_keys = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.sentinel_service_name = mymaster {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.socket_timeout = 0.1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.trace_requests = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler.trace_sqlalchemy = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler_jaeger.process_tags = {} {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler_jaeger.service_name_prefix = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] profiler_otlp.service_name_prefix = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.enforce_new_defaults = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.policy_default_rule = default {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.policy_file = policy.yaml {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.group = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.helper_command = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] privsep_osbrick.user = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.group = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.helper_command = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] cinder_sys_admin.user = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.auth_section = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.auth_type = password {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:15 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.cafile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.collect_timing = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.send_service_user_token = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.split_loggers = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.tls_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] service_user.tls_min_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.auth_section = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.auth_type = password {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.collect_timing = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.region_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.split_loggers = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.tls_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] glance.tls_min_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.backend_availability_zone = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.chap_password = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.chap_username = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.disk_geometry = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_client_cert = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_client_cert_key = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_data_namespace = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.driver_use_ssl = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.extra_capabilities = {} {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.filter_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.goodness_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iscsi_target_flags = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iscsi_write_cache = on {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iser_helper = tgtadm {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iser_port = 3260 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.lvm_share_target = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.lvm_type = auto {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.num_shell_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.replication_device = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.report_discard_supported = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.reserved_percentage = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_helper = tgtadm {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_port = 3260 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_protocol = iscsi {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.trace_flags = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.unique_fqdn_network = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.use_chap_auth = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_backend_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_clear = zero {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_clear_ionice = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_clear_size = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_reports.file_event_handler = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_reports.log_dir = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.backend_host = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.chap_password = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.chap_username = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.disk_geometry = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_client_cert = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.extra_capabilities = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.filter_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.goodness_function = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iser_helper = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iser_ip_address = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iser_port = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.lvm_share_target = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.lvm_type = auto {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.num_shell_tries = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.replication_device = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.report_discard_supported = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.reserved_percentage = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.scst_target_driver = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.storage_protocol = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_helper = lioadm {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_ip_address = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_port = 3260 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.trace_flags = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.use_chap_auth = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_clear = zero {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_clear_size = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] lvmdriver-1.volumes_dir = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_notifications.driver = [] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_notifications.retry = -1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] key_manager.fixed_key = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.barbican_api_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.barbican_endpoint = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.barbican_endpoint_type = public {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.barbican_region_name = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.cafile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.collect_timing = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.number_of_retries = 60 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.retry_delay = 1 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.send_service_user_token = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.split_loggers = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.tls_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.tls_min_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.verify_ssl = True {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican.verify_ssl_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.auth_section = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.auth_type = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.cafile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.certfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.collect_timing = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.insecure = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.keyfile = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.split_loggers = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.timeout = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.tls_ciphers = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] barbican_service_user.tls_min_version = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.approle_role_id = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.approle_secret_id = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.auth_method = approle {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.auth_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.kv_mountpoint = secret {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.kv_path = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.kv_version = 2 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.namespace = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.root_token_id = **** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.ssl_ca_crt_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.timeout = 60.0 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.token_file = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.token_role = None {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.use_ssl = False {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:15:16 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] ******************************************************************************** {{(pid=76044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:15:16 devstack sudo[76207]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:16 devstack sudo[76262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:16 devstack sudo[76262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:16 devstack sudo[76262]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.298s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:15:16 devstack cinder-volume[76203]: INFO cinder.brick.local_dev.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:16 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:16 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:16 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG cinder.brick.local_dev.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76203) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 08:15:16 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:16 devstack sudo[76446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:16 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:17 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:17 devstack sudo[76627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:17 devstack sudo[76627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:17 devstack sudo[76627]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:17 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 08:15:17 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:17 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:17 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:17 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:17 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:18 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:18 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:18 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:18 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:18 devstack sudo[76911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:18 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:18 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:18 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:18 devstack sudo[76914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:18 devstack sudo[76914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:19 devstack sudo[76914]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:19 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:19 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:19 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.350s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:19 devstack cinder-volume[76203]: INFO cinder.volume.drivers.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:19 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:19 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:19 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:19 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:19 devstack sudo[77011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:19 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:20 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:20 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:20 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:20 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:20 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:20 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:20 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:20 devstack sudo[77026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:20 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:20 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:20 devstack cinder-volume[76203]: INFO cinder.volume.driver [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG cinder.volume.driver [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76203) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_db.sqlalchemy.engines [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76203) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writer thread running {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG cinder.db.api [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Building query based on filter {{(pid=76203) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG cinder.image.image_utils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76203) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:15:20 devstack cinder-volume[76203]: INFO cinder.keymgr.migration [None req-2798cd52-d6a8-49b6-9325-9cb651b2e128 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:20 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:21 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:21 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:21 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:21 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:21 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:21 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:21 devstack sudo[77037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:21 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:21 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:21 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:21 devstack sudo[77041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:21 devstack sudo[77041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:22 devstack sudo[77041]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG cinder.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Notifying Schedulers of capabilities ... {{(pid=76203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:15:22 devstack cinder-volume[76203]: INFO cinder.volume.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Driver initialization completed successfully. Nov 05 08:15:22 devstack cinder-volume[76203]: INFO cinder.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Initiating service 2 cleanup Nov 05 08:15:22 devstack cinder-volume[76203]: INFO cinder.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Service 2 cleanup completed. Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG cinder.service [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Creating RPC server for service cinder-volume {{(pid=76203) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG cinder.service [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76203) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:15:22 devstack cinder-volume[76203]: INFO cinder.volume.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:22 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:15:22 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:22 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:22 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:22 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:22 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:22 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:22 devstack sudo[77052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:15:22 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:23 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:23 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:23 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:15:23 devstack sudo[77055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:15:23 devstack sudo[77055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:15:23 devstack sudo[77055]: pam_unix(sudo:session): session closed for user root Nov 05 08:15:23 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:15:23 devstack cinder-volume[76203]: INFO cinder.volume.manager [None req-9be79f6c-a52c-4ff7-ab0f-d4d9401bae7f None None] Driver post RPC initialization completed successfully. Nov 05 08:15:25 devstack cinder-volume[76044]: DEBUG dbcounter [-] [76044] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:32 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:33 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:15:36 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager._thread_info {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:15:36 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread count: 6 {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:15:36 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread info: [<_MainThread(MainThread, started 132267285913728)>, , , , , ] {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:36 devstack sudo[79547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:16:36 devstack sudo[79547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:36 devstack sudo[79547]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:36 devstack sudo[79553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:16:36 devstack sudo[79553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:36 devstack sudo[79553]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:36 devstack sudo[79580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:16:36 devstack sudo[79580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:37 devstack sudo[79580]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:16:37 devstack sudo[79583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:16:37 devstack sudo[79583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:16:37 devstack sudo[79583]: pam_unix(sudo:session): session closed for user root Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG cinder.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Notifying Schedulers of capabilities ... {{(pid=76203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager._thread_info {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread count: 6 {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:16:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread info: [<_MainThread(MainThread, started 132267285913728)>, , , , , ] {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:17:33 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:SELECT=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:17:33 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:UPDATE=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:36 devstack sudo[82589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:17:36 devstack sudo[82589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:36 devstack sudo[82589]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:36 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:17:36 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:36 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:36 devstack sudo[82603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:17:36 devstack sudo[82603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:37 devstack sudo[82603]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:17:37 devstack sudo[82613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:17:37 devstack sudo[82613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:17:37 devstack sudo[82613]: pam_unix(sudo:session): session closed for user root Nov 05 08:17:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:17:37 devstack cinder-volume[76203]: DEBUG cinder.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Notifying Schedulers of capabilities ... {{(pid=76203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:18:36 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:18:36 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:18:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:36 devstack sudo[84810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:18:36 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:36 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:36 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:18:36 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:37 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:37 devstack sudo[84849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:18:37 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:37 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:18:37 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:18:37 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:18:37 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG cinder.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Notifying Schedulers of capabilities ... {{(pid=76203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager._thread_info {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread count: 6 {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:18:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread info: [<_MainThread(MainThread, started 132267285913728)>, , , , , ] {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:19:33 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:SELECT=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:19:33 devstack cinder-volume[76203]: DEBUG dbcounter [-] [76203] Writing DB stats cinder:UPDATE=1 {{(pid=76203) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:19:36 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:19:36 devstack cinder-volume[76203]: DEBUG cinder.volume.drivers.lvm [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Updating volume stats {{(pid=76203) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 08:19:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:36 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 08:19:36 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:36 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:36 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:36 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:19:36 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:37 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:37 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 08:19:37 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:37 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:37 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 08:19:37 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:37 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_concurrency.processutils [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76203) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG cinder.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Notifying Schedulers of capabilities ... {{(pid=76203) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG oslo_service.periodic_task [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] Running periodic task VolumeManager._thread_info {{(pid=76203) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread count: 6 {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:19:37 devstack cinder-volume[76203]: DEBUG cinder.volume.manager [None req-1073fa01-f6e7-40f3-bc86-e010615846dc None None] thread info: [<_MainThread(MainThread, started 132267285913728)>, , , , , ] {{(pid=76203) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:19:40 devstack cinder-volume[76044]: INFO oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Caught SIGTERM, stopping children Nov 05 08:19:40 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Acquiring lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:40 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Acquired lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:40 devstack cinder-volume[76044]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Releasing lock "singleton_lock" {{(pid=76044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:40 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Stop services. {{(pid=76044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 08:19:40 devstack cinder-volume[76044]: DEBUG oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Killing children. {{(pid=76044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 08:19:40 devstack cinder-volume[76044]: INFO oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Waiting on 1 children to exit Nov 05 08:19:42 devstack cinder-volume[76203]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Acquiring lock "singleton_lock" {{(pid=76203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:42 devstack cinder-volume[76203]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Acquired lock "singleton_lock" {{(pid=76203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:42 devstack cinder-volume[76203]: DEBUG oslo_concurrency.lockutils [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Releasing lock "singleton_lock" {{(pid=76203) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:42 devstack cinder-volume[76203]: WARNING amqp [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:42 devstack cinder-volume[76203]: WARNING amqp [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:42 devstack cinder-volume[76044]: INFO oslo_service.backend._eventlet.service [None req-6b018063-1e78-44df-addd-755061215eb3 None None] Child 76203 exited with status 0 Nov 05 08:19:42 devstack cinder-volume[86261]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:19:42 devstack cinder-volume[86261]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:19:42 devstack cinder-volume[86261]: we strongly recommend against using it for new projects. Nov 05 08:19:42 devstack cinder-volume[86261]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:19:42 devstack cinder-volume[86261]: framework. For more detail see Nov 05 08:19:42 devstack cinder-volume[86261]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:19:42 devstack cinder-volume[86261]: import eventlet # noqa Nov 05 08:19:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:44 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:45 devstack cinder-volume[86261]: INFO dbcounter [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Registered counter for database cinder Nov 05 08:19:45 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:19:45 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writer thread running {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:19:45 devstack cinder-volume[86261]: INFO cinder.rpc [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:19:45 devstack cinder-volume[86261]: INFO cinder.rpc [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:19:45 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:19:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Determined volume DB was empty at startup. Nov 05 08:19:45 devstack cinder-volume[86261]: DEBUG cinder.volume.manager [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86261) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:19:45 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 08:19:45 devstack cinder-volume[86261]: WARNING stevedore.named [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:19:45 devstack cinder-volume[86261]: WARNING castellan.key_manager [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:19:45 devstack cinder-volume[86261]: WARNING cinder.keymgr.conf_key_mgr [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:19:46 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:19:46 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Starting 1 workers Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Started child 86479 {{(pid=86261) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Full set of CONF: {{(pid=86261) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] ******************************************************************************** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Configuration options gathered from: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] ================================================================================ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] allow_availability_zone_fallback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] allow_compression_on_image_upload = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] allowed_direct_url_schemes = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] api_rate_limit = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] auth_strategy = keystone {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_host = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_stats_polling_interval = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backup_api_class = cinder.backup.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backup_name_template = backup-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backup_use_same_host = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86479]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backup_use_temp_snapshot = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] chap_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] chap_username = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_internal_tenant_project_id = 5a88b287820a4a3690ad674761a09d56 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_internal_tenant_user_id = ec34c71f731c473985fe40de274fb79e {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cluster = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] compression_format = gzip {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] compute_api_class = cinder.compute.nova.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] config_dir = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] config_source = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] control_exchange = openstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] debug = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] default_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] default_group_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] default_volume_type = QuobyteHD {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] disk_geometry = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_client_cert = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_client_cert_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_data_namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_ssl_cert_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_ssl_cert_verify = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] driver_use_ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] enable_new_services = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] enable_unsupported_driver = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] enabled_backends = ['QuobyteHD'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] enforce_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] filter_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_api_insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_api_ssl_compression = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_ca_certificates_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_catalog_info = image:glance:publicURL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_num_retries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance_request_timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] goodness_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] graceful_shutdown_timeout = 5 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] group_api_class = cinder.group.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] host = devstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_compress_on_upload = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_conversion_address_space_limit = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_conversion_cpu_limit = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_conversion_disable = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_introspection_address_space_limit = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_introspection_cpu_limit = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_upload_use_cinder_backend = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_upload_use_internal_tenant = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_volume_cache_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_volume_cache_max_count = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] image_volume_cache_max_size_gb = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] init_host_max_objects_retrieval = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] instance_format = [instance: %(uuid)s] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iscsi_target_flags = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iscsi_write_cache = on {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iser_helper = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iser_ip_address = 192.168.122.178 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iser_port = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_color = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_config_append = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_dir = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_options = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_rotate_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_rotate_interval_type = days {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] log_rotation_type = none {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] max_age = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] max_logfile_count = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] max_logfile_size_mb = 200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] max_over_subscription_ratio = 20.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] message_reap_interval = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] message_ttl = 2592000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] migration_create_volume_timeout_secs = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] monkey_patch = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] monkey_patch_modules = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] my_ip = 192.168.122.178 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] no_snapshot_gb_quota = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] num_iser_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] num_shell_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] num_volume_device_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] nvmeof_conn_info_version = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] nvmet_ns_id = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] nvmet_port_id = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_max_limit = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_ext_list = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_listen_port = 8776 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_use_ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] osapi_volume_workers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] per_volume_size_limit = -1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] periodic_fuzzy_delay = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] periodic_interval = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] public_endpoint = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] publish_errors = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_backup_gigabytes = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_backups = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_gigabytes = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_groups = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_snapshots = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] quota_volumes = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] rate_limit_burst = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] rate_limit_except_level = CRITICAL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] rate_limit_interval = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] reinit_driver_count = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] replication_device = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] report_discard_supported = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] report_interval = 120 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] reservation_clean_interval = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] reservation_expire = 86400 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] reserved_image_namespaces = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] reserved_percentage = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] rpc_response_timeout = 120 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] run_external_periodic_tasks = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] scst_target_driver = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] scst_target_iqn_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_down_time = 720 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] shell_completion = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] snapshot_name_template = snapshot-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] state_path = /opt/stack/data/cinder {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] storage_availability_zone = nova {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] storage_protocol = iSCSI {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] syslog_log_facility = LOG_USER {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_helper = lioadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_ip_address = 192.168.122.178 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_port = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_protocol = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] target_secondary_ip_addresses = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] trace_flags = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] transport_url = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] until_refresh = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_chap_auth = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_default_quota_class = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_journal = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_json = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_stderr = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] use_syslog = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.remotefs [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86479) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] verify_glance_signatures = enabled {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_api_class = cinder.volume.api.API {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_backend_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_clear = zero {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_clear_ionice = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_clear_size = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_copy_bps_limit = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_dd_blocksize = 1M {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_name_template = volume-%s {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_service_inithost_offload = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volume_usage_audit_period = month {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] zoning_mode = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_concurrency.disable_process_locking = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.auth_type = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.auth_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.cache = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.include_service_catalog = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.interface = public {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcache_username = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.region_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.service_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.backend = dogpile.cache.null {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.backend_argument = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.backend_expiration_time = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.config_prefix = cache.oslo {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.debug_cache_backend = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.enable_retry_client = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.enable_socket_keepalive = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.expiration_time = 600 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.hashclient_retry_attempts = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_dead_retry = 300 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_pool_maxsize = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_sasl_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.proxies = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.redis_db = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.redis_server = localhost:6379 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.retry_attempts = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.retry_delay = 0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.socket_keepalive_count = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.socket_keepalive_idle = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.socket_keepalive_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.socket_timeout = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.tls_allowed_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.tls_cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.tls_certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.tls_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.tls_keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cache.username = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] coordination.backend_url = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.asyncio_connection = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.asyncio_slave_connection = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.backend = sqlalchemy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.connection = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.connection_debug = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.connection_parameters = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.connection_recycle_time = 3600 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.connection_trace = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.db_inc_retry_interval = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.db_max_retries = 20 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.db_max_retry_interval = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.db_retry_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.max_overflow = 50 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.max_pool_size = 5 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.max_retries = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.mysql_wsrep_sync_wait = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.pool_timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.retry_interval = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.slave_connection = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.sqlite_synchronous = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.synchronous_reader = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] database.use_db_reconnect = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_tracing.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.connection_string = messaging:// {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.es_doc_type = notification {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.es_scroll_size = 10000 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.es_scroll_time = 2m {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.filter_error_trace = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.hmac_keys = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.sentinel_service_name = mymaster {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.socket_timeout = 0.1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.trace_requests = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler.trace_sqlalchemy = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler_jaeger.process_tags = {} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler_jaeger.service_name_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] profiler_otlp.service_name_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.enforce_new_defaults = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.policy_default_rule = default {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.policy_file = policy.yaml {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.group = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.helper_command = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] privsep_osbrick.user = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.group = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.helper_command = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] cinder_sys_admin.user = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.auth_type = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.collect_timing = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.send_service_user_token = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.tls_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] service_user.tls_min_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.auth_type = password {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.collect_timing = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.region_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.tls_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] glance.tls_min_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.backend_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.chap_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.chap_username = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.disk_geometry = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_client_cert = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_client_cert_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_data_namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.driver_use_ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.extra_capabilities = {} {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.filter_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.goodness_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iscsi_target_flags = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iscsi_write_cache = on {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iser_helper = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iser_port = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_host = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_login = admin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_mount_options = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_private_key = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_share_path = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.num_shell_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.quobyte_volume_url = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.replication_device = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.report_discard_supported = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.reserved_percentage = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_helper = tgtadm {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_port = 3260 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_protocol = iscsi {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.trace_flags = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.unique_fqdn_network = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.use_chap_auth = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_backend_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_clear = zero {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_clear_ionice = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_clear_size = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_reports.file_event_handler = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86479) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 08:19:46 devstack cinder-volume[86479]: WARNING cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 08:19:46 devstack cinder-volume[86479]: WARNING cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_reports.log_dir = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.backend_availability_zone = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.backend_host = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.chap_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.chap_username = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.chiscsi_conf = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.disk_geometry = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_client_cert = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_data_namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.driver_use_ssl = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.extra_capabilities = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.filter_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.goodness_function = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iser_helper = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iser_ip_address = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iser_port = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.iser_target_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_host = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_login = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_mount_options = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_password = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_private_key = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_share_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_ssh_port = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.num_shell_tries = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.nvmet_port_id = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.replication_device = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.report_discard_supported = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.reserved_percentage = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.scst_target_driver = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.storage_protocol = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_helper = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_ip_address = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_port = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_prefix = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_protocol = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.trace_flags = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.use_chap_auth = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_clear = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_clear_size = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] QuobyteHD.volumes_dir = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_notifications.driver = [] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_notifications.retry = -1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] key_manager.fixed_key = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.barbican_api_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.barbican_endpoint = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.barbican_endpoint_type = public {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.barbican_region_name = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.collect_timing = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.number_of_retries = 60 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.retry_delay = 1 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.send_service_user_token = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.tls_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.tls_min_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.verify_ssl = True {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican.verify_ssl_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.auth_section = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.auth_type = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.cafile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.certfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.collect_timing = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.insecure = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.keyfile = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.split_loggers = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.timeout = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.tls_ciphers = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] barbican_service_user.tls_min_version = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.approle_role_id = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.approle_secret_id = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.auth_method = approle {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.auth_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.kv_mountpoint = secret {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.kv_path = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.kv_version = 2 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.namespace = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.root_token_id = **** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.ssl_ca_crt_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.timeout = 60.0 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.token_file = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.token_role = None {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.use_ssl = False {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:19:46 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] ******************************************************************************** {{(pid=86261) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:19:46 devstack quobyte-client[86482]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 08:19:46 devstack quobyte-client[86482]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:19:46 devstack cinder-volume[86479]: INFO cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee ... Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 -c /etc/quobyte/client-cinder.cfg {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:46 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 -c /etc/quobyte/client-cinder.cfg Nov 05 08:19:46 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:46 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.406s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:46 devstack cinder-volume[86479]: INFO cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee succeeded Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:19:46 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:46 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:19:46 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:47 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.242s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.volume.driver [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.volume.driver [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86479) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_db.sqlalchemy.engines [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86479) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG dbcounter [-] [86479] Writer thread running {{(pid=86479) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.db.api [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Building query based on filter {{(pid=86479) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.image.image_utils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86479) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.keymgr.migration [None req-a904a294-6a42-4c01-8f76-de5c7b6c199a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:47 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:19:47 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:47 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.236s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Notifying Schedulers of capabilities ... {{(pid=86479) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Driver initialization completed successfully. Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Initiating service 3 cleanup Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Service 3 cleanup completed. Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.service [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Creating RPC server for service cinder-volume {{(pid=86479) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.service [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86479) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:47 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:19:47 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:47 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:47 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.255s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:47 devstack cinder-volume[86479]: INFO cinder.volume.manager [None req-aecb0b90-29f0-4349-a225-89120c1f2ed5 None None] Driver post RPC initialization completed successfully. Nov 05 08:19:50 devstack cinder-volume[86479]: DEBUG oslo_service.periodic_task [None req-a62e4771-f083-4386-b6da-cb020cc6904a None None] Running periodic task VolumeManager._thread_info {{(pid=86479) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:19:50 devstack cinder-volume[86479]: DEBUG cinder.volume.manager [None req-a62e4771-f083-4386-b6da-cb020cc6904a None None] thread count: 6 {{(pid=86479) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:19:50 devstack cinder-volume[86479]: DEBUG cinder.volume.manager [None req-a62e4771-f083-4386-b6da-cb020cc6904a None None] thread info: [<_MainThread(MainThread, started 129700544249984)>, , , , , ] {{(pid=86479) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=86479) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG cinder.volume.drivers.quobyte [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=86479) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86479) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:19:52 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:19:52 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:19:52 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG oslo_concurrency.processutils [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.247s {{(pid=86479) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:19:52 devstack cinder-volume[86479]: DEBUG cinder.manager [None req-2c818cac-bcf7-4e37-b50b-d1ad562b5e1a None None] Notifying Schedulers of capabilities ... {{(pid=86479) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:19:53 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Caught SIGTERM, stopping children Nov 05 08:19:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Acquiring lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Acquired lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:53 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Releasing lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:53 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Stop services. {{(pid=86261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 08:19:53 devstack cinder-volume[86261]: DEBUG oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Killing children. {{(pid=86261) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 08:19:53 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Waiting on 1 children to exit Nov 05 08:19:55 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Acquiring lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:55 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Acquired lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:55 devstack cinder-volume[86479]: DEBUG oslo_concurrency.lockutils [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Releasing lock "singleton_lock" {{(pid=86479) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:19:55 devstack cinder-volume[86479]: WARNING amqp [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:55 devstack cinder-volume[86479]: WARNING amqp [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 08:19:55 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [None req-4d5816d5-18fb-4db9-8f2f-e179e66fe508 None None] Child 86479 exited with status 0 Nov 05 08:19:56 devstack cinder-volume[86798]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 08:19:56 devstack cinder-volume[86798]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:19:56 devstack cinder-volume[86798]: we strongly recommend against using it for new projects. Nov 05 08:19:56 devstack cinder-volume[86798]: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:19:56 devstack cinder-volume[86798]: framework. For more detail see Nov 05 08:19:56 devstack cinder-volume[86798]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:19:56 devstack cinder-volume[86798]: import eventlet # noqa Nov 05 08:19:59 devstack cinder-volume[86798]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 08:19:59 devstack cinder-volume[86798]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 08:19:59 devstack cinder-volume[86798]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86798) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 08:20:00 devstack cinder-volume[86798]: INFO dbcounter [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Registered counter for database cinder Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_db.sqlalchemy.engines [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG dbcounter [-] [86798] Writer thread running {{(pid=86798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:00 devstack cinder-volume[86798]: INFO cinder.rpc [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 08:20:00 devstack cinder-volume[86798]: INFO cinder.rpc [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_db.sqlalchemy.engines [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:00 devstack cinder-volume[86798]: INFO cinder.volume.manager [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Determined volume DB was empty at startup. Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG cinder.volume.manager [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86798) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 08:20:00 devstack cinder-volume[86798]: WARNING stevedore.named [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 08:20:00 devstack cinder-volume[86798]: WARNING castellan.key_manager [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:00 devstack cinder-volume[86798]: WARNING cinder.keymgr.conf_key_mgr [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 08:20:00 devstack cinder-volume[86798]: INFO cinder.volume.manager [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_db.sqlalchemy.engines [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86798) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:00 devstack cinder-volume[86798]: INFO oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Starting 1 workers Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Started child 87092 {{(pid=86798) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Full set of CONF: {{(pid=86798) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] ******************************************************************************** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] Configuration options gathered from: {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] ================================================================================ {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] allow_availability_zone_fallback = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] allow_compression_on_image_upload = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] allowed_direct_url_schemes = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] api_rate_limit = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[87092]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] auth_strategy = keystone {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_availability_zone = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_host = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_stats_polling_interval = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backup_api_class = cinder.backup.api.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backup_name_template = backup-%s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backup_use_same_host = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backup_use_temp_snapshot = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] chap_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] chap_username = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_internal_tenant_project_id = 5a88b287820a4a3690ad674761a09d56 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_internal_tenant_user_id = ec34c71f731c473985fe40de274fb79e {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cluster = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] compression_format = gzip {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] compute_api_class = cinder.compute.nova.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] config_dir = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] config_source = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] control_exchange = openstack {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] debug = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] default_availability_zone = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] default_group_type = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] default_volume_type = QuobyteHD {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] disk_geometry = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_client_cert = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_client_cert_key = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_data_namespace = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_ssl_cert_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_ssl_cert_verify = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] driver_use_ssl = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] enable_new_services = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] enable_unsupported_driver = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] enabled_backends = ['QuobyteHD'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] enforce_multipath_for_image_xfer = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] filter_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_api_insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_api_ssl_compression = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_ca_certificates_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_catalog_info = image:glance:publicURL {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_num_retries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance_request_timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] goodness_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] graceful_shutdown_timeout = 5 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] group_api_class = cinder.group.api.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] host = devstack {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_compress_on_upload = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_conversion_address_space_limit = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_conversion_cpu_limit = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_conversion_disable = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_introspection_address_space_limit = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_introspection_cpu_limit = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_upload_use_cinder_backend = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_upload_use_internal_tenant = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_volume_cache_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_volume_cache_max_count = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] image_volume_cache_max_size_gb = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] init_host_max_objects_retrieval = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] instance_format = [instance: %(uuid)s] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iscsi_target_flags = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iscsi_write_cache = on {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iser_helper = tgtadm {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iser_ip_address = 192.168.122.178 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iser_port = 3260 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_color = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_config_append = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_dir = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_options = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_rotate_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_rotate_interval_type = days {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] log_rotation_type = none {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] max_age = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] max_logfile_count = 30 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] max_logfile_size_mb = 200 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] max_over_subscription_ratio = 20.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] message_reap_interval = 86400 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] message_ttl = 2592000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] migration_create_volume_timeout_secs = 300 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] monkey_patch = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] monkey_patch_modules = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] my_ip = 192.168.122.178 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] no_snapshot_gb_quota = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] num_iser_scan_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] num_shell_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] num_volume_device_scan_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] nvmeof_conn_info_version = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] nvmet_ns_id = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] nvmet_port_id = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_max_limit = 1000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_ext_list = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_listen_port = 8776 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_use_ssl = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] osapi_volume_workers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] per_volume_size_limit = -1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] periodic_fuzzy_delay = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] periodic_interval = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] public_endpoint = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] publish_errors = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_backup_gigabytes = 1000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_backups = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_gigabytes = 1000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_groups = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_snapshots = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] quota_volumes = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] rate_limit_burst = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] rate_limit_except_level = CRITICAL {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] rate_limit_interval = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] reinit_driver_count = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] replication_device = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] report_discard_supported = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] report_interval = 120 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] reservation_clean_interval = 86400 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] reservation_expire = 86400 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] reserved_image_namespaces = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] reserved_percentage = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] rpc_response_timeout = 120 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] run_external_periodic_tasks = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] scst_target_driver = iscsi {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87092) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] scst_target_iqn_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_down_time = 720 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] shell_completion = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] snapshot_name_template = snapshot-%s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] split_loggers = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] state_path = /opt/stack/data/cinder {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] storage_availability_zone = nova {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] storage_protocol = iSCSI {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] syslog_log_facility = LOG_USER {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_helper = lioadm {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_ip_address = 192.168.122.178 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_port = 3260 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_protocol = iscsi {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] target_secondary_ip_addresses = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] trace_flags = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] transport_url = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] until_refresh = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_chap_auth = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_default_quota_class = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_journal = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_json = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_multipath_for_image_xfer = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_stderr = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] use_syslog = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] verify_glance_signatures = enabled {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_api_class = cinder.volume.api.API {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_backend_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_clear = zero {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_clear_ionice = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_clear_size = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_copy_bps_limit = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_dd_blocksize = 1M {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_name_template = volume-%s {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_service_inithost_offload = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volume_usage_audit_period = month {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] zoning_mode = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_concurrency.disable_process_locking = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.auth_section = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.auth_type = password {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.auth_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.cache = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.include_service_catalog = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.interface = public {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcache_username = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.region_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.service_type = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.backend = dogpile.cache.null {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.backend_argument = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.backend_expiration_time = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.config_prefix = cache.oslo {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.debug_cache_backend = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.enable_retry_client = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.enable_socket_keepalive = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.expiration_time = 600 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.hashclient_retry_attempts = 2 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_dead_retry = 300 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_pool_maxsize = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_sasl_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.proxies = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.redis_db = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.redis_server = localhost:6379 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.retry_attempts = 2 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.retry_delay = 0.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.socket_keepalive_count = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.socket_keepalive_idle = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.socket_keepalive_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.socket_timeout = 1.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.tls_allowed_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.tls_cafile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.tls_certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:00 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.tls_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.tls_keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cache.username = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] coordination.backend_url = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.asyncio_connection = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.asyncio_slave_connection = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.backend = sqlalchemy {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.connection = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.connection_debug = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.connection_parameters = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.connection_recycle_time = 3600 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.connection_trace = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.db_inc_retry_interval = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.db_max_retries = 20 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.db_max_retry_interval = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.db_retry_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.max_overflow = 50 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.max_pool_size = 5 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.max_retries = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.mysql_wsrep_sync_wait = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.pool_timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.retry_interval = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.slave_connection = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.sqlite_synchronous = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.synchronous_reader = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] database.use_db_reconnect = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_tracing.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.connection_string = messaging:// {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.es_doc_type = notification {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.es_scroll_size = 10000 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.es_scroll_time = 2m {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.filter_error_trace = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.hmac_keys = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.sentinel_service_name = mymaster {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.socket_timeout = 0.1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.trace_requests = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler.trace_sqlalchemy = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler_jaeger.process_tags = {} {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler_jaeger.service_name_prefix = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] profiler_otlp.service_name_prefix = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.enforce_new_defaults = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.policy_default_rule = default {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.policy_file = policy.yaml {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87092) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.group = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.helper_command = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] privsep_osbrick.user = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.group = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Running cmd (subprocess): mount.quobyte {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.helper_command = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] cinder_sys_admin.user = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.auth_section = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.auth_type = password {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.cafile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.collect_timing = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.send_service_user_token = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.split_loggers = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.tls_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] service_user.tls_min_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.auth_section = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.auth_type = password {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.collect_timing = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.region_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.split_loggers = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.tls_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] glance.tls_min_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.backend_availability_zone = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.chap_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.chap_username = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.disk_geometry = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_client_cert = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_client_cert_key = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_data_namespace = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.driver_use_ssl = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.extra_capabilities = {} {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.filter_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.goodness_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iscsi_target_flags = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iscsi_write_cache = on {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iser_helper = tgtadm {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iser_port = 3260 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_host = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_login = admin {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_mount_options = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_private_key = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_share_path = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.num_shell_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.quobyte_volume_url = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.replication_device = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.report_discard_supported = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.reserved_percentage = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_helper = tgtadm {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_port = 3260 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_protocol = iscsi {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.trace_flags = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.unique_fqdn_network = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.use_chap_auth = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_backend_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_clear = zero {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_clear_ionice = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_clear_size = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_reports.file_event_handler = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_reports.log_dir = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.backend_availability_zone = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.backend_host = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.chap_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.chap_username = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.chiscsi_conf = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.disk_geometry = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_client_cert = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_data_namespace = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.driver_use_ssl = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.extra_capabilities = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.filter_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.goodness_function = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iser_helper = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iser_ip_address = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iser_port = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.iser_target_prefix = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_host = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_login = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_mount_options = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_password = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_private_key = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_share_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_ssh_port = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.num_shell_tries = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.nvmet_port_id = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack quobyte-client[87096]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.replication_device = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.report_discard_supported = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.reserved_percentage = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.scst_target_driver = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.storage_protocol = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack quobyte-client[87096]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_helper = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_ip_address = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_port = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_prefix = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_protocol = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.trace_flags = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.use_chap_auth = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_clear = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_clear_size = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] QuobyteHD.volumes_dir = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_notifications.driver = [] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_notifications.retry = -1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] key_manager.fixed_key = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.barbican_api_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.barbican_endpoint = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.barbican_endpoint_type = public {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.barbican_region_name = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.cafile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.collect_timing = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.number_of_retries = 60 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.retry_delay = 1 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.send_service_user_token = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.split_loggers = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.tls_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.tls_min_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.verify_ssl = True {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican.verify_ssl_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.auth_section = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.auth_type = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.cafile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.certfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.collect_timing = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.insecure = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.keyfile = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.split_loggers = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.timeout = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.tls_ciphers = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] barbican_service_user.tls_min_version = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.approle_role_id = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.approle_secret_id = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.auth_method = approle {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.auth_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.kv_mountpoint = secret {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.kv_path = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.kv_version = 2 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.namespace = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.root_token_id = **** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.ssl_ca_crt_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.timeout = 60.0 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.token_file = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.token_role = None {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.use_ssl = False {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:01 devstack cinder-volume[86798]: DEBUG oslo_service.backend._eventlet.service [None req-80a1a4ff-35c0-4b4f-ae7d-0f843f4cc305 None None] ******************************************************************************** {{(pid=86798) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:20:01 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:01 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.volume.driver [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.driver [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_db.sqlalchemy.engines [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writer thread running {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.db.api [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Building query based on filter {{(pid=87092) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87092) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.keymgr.migration [None req-8f0a4ebc-48f9-4974-8bae-5c9e9dbfc21c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 08:20:01 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:20:01 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:01 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Driver initialization completed successfully. Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Initiating service 3 cleanup Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Service 3 cleanup completed. Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.service [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Creating RPC server for service cinder-volume {{(pid=87092) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.service [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87092) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 08:20:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:20:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:20:01 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:20:01 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:20:02 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Nov 05 08:20:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:20:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20ac91f7-9039-480f-a598-6d8ce6c86873 None None] Driver post RPC initialization completed successfully. Nov 05 08:20:10 devstack cinder-volume[86798]: DEBUG dbcounter [-] [86798] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86798) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:11 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:12 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:20:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:20:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 6 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:20:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Flow 'volume_create_manager' (4a2df3be-0c13-4e8e-92de-dae35bbcc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98679895-d50c-4d96-9de6-3cf799a97700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98679895-d50c-4d96-9de6-3cf799a97700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1550840287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0067e9-6f16-4ea8-9c1b-174c2d933096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8d07c96e34dd0bfdbfe877cb722ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:01Z,use_quota=True,user_id='d98862d21870453f994ca01c988e0d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106ce09a-50f4-4a0e-a1c4-c1286a1639c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106ce09a-50f4-4a0e-a1c4-c1286a1639c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dde0a-e941-46f5-a15a-dcfda7292bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dde0a-e941-46f5-a15a-dcfda7292bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0067e9-6f16-4ea8-9c1b-174c2d933096', 'volume_name': 'volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a0adec-24e7-455f-86f2-2a7b8d742ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a0adec-24e7-455f-86f2-2a7b8d742ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95ba0cc-e15d-4d0e-8b4b-7f227cf606d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Volume bb0067e9-6f16-4ea8-9c1b-174c2d933096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096', 'volume_size': 1} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1550840287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0067e9-6f16-4ea8-9c1b-174c2d933096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dea8d07c96e34dd0bfdbfe877cb722ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:01Z,use_quota=True,user_id='d98862d21870453f994ca01c988e0d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Creating volume bb0067e9-6f16-4ea8-9c1b-174c2d933096 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:21:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:01 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 1073741824 Nov 05 08:21:01 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:02 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 1073741824" returned: 0 in 0.654s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:02 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 Nov 05 08:21:02 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:02 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95ba0cc-e15d-4d0e-8b4b-7f227cf606d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d270ba7-7afe-4f8b-ba70-d2803b1911a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Volume volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 (bb0067e9-6f16-4ea8-9c1b-174c2d933096): created successfully Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d270ba7-7afe-4f8b-ba70-d2803b1911a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Flow 'volume_create_manager' (4a2df3be-0c13-4e8e-92de-dae35bbcc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8733a6de-7897-495b-964e-fc07c880ae6d tempest-TaggedAttachmentsTest-398327662 None] Created volume successfully. Nov 05 08:21:12 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:21:12 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:18 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:21:18 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:18 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 6 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:21:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Flow 'volume_create_manager' (a555adba-1511-4825-a66b-49c5b53dc403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fe6853-c8ca-44ea-81af-f8a9799daa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82fe6853-c8ca-44ea-81af-f8a9799daa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-82957268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3716c94e-6584-4a61-a3b4-6254918e29b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c525cf7aaae485781f6ac48a775077c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:33Z,use_quota=True,user_id='e592032525204d86951c9696b72a3449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a396456c-e371-462b-be15-16c7cd5ea2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a396456c-e371-462b-be15-16c7cd5ea2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f95d3-99e5-4e3d-a916-c562320a051f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f95d3-99e5-4e3d-a916-c562320a051f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3716c94e-6584-4a61-a3b4-6254918e29b7', 'volume_name': 'volume-3716c94e-6584-4a61-a3b4-6254918e29b7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef97de02-d1df-4f1d-b13b-13d0a952aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef97de02-d1df-4f1d-b13b-13d0a952aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c113302-f5bb-43d7-9546-e7ec5648f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Volume 3716c94e-6584-4a61-a3b4-6254918e29b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3716c94e-6584-4a61-a3b4-6254918e29b7', 'volume_size': 1} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-82957268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3716c94e-6584-4a61-a3b4-6254918e29b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c525cf7aaae485781f6ac48a775077c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:33Z,use_quota=True,user_id='e592032525204d86951c9696b72a3449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Creating volume 3716c94e-6584-4a61-a3b4-6254918e29b7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:21:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:33 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 1073741824 Nov 05 08:21:33 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:34 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 1073741824" returned: 0 in 1.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:34 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 Nov 05 08:21:34 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:35 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7" returned: 0 in 0.790s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c113302-f5bb-43d7-9546-e7ec5648f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3716c94e-6584-4a61-a3b4-6254918e29b7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ad2d5-72f2-471d-b24f-5fd598af8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Volume volume-3716c94e-6584-4a61-a3b4-6254918e29b7 (3716c94e-6584-4a61-a3b4-6254918e29b7): created successfully Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ad2d5-72f2-471d-b24f-5fd598af8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Flow 'volume_create_manager' (a555adba-1511-4825-a66b-49c5b53dc403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ba084783-f8fb-465b-8478-667d32cbe9c8 tempest-VolumesAdminNegativeTest-1059348253 None] Created volume successfully. Nov 05 08:21:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Acquiring lock "cinder-3716c94e-6584-4a61-a3b4-6254918e29b7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:21:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "cinder-3716c94e-6584-4a61-a3b4-6254918e29b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:21:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Acquiring lock "cinder-quobyte-3716c94e-6584-4a61-a3b4-6254918e29b7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:21:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "cinder-quobyte-3716c94e-6584-4a61-a3b4-6254918e29b7" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:21:38 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdgqxkzri/privsep.sock'] Nov 05 08:21:39 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdgqxkzri/privsep.sock Nov 05 08:21:39 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 08:21:40 devstack cinder-volume[87092]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 08:21:41 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:41 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Spawned new privsep daemon via rootwrap Nov 05 08:21:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Accepted privsep connection to /tmp/tmpdgqxkzri/privsep.sock {{(pid=87092) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 08:21:41 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 08:21:41 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 08:21:41 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 08:21:41 devstack cinder-volume[87092]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88368 Nov 05 08:21:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac5244-3694-442e-95b6-da7ab043b1b4]: (2,) {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:21:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[85125f15-091e-4680-b470-62ff4016a574]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:21:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:42 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 Nov 05 08:21:42 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:43 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7" returned: 0 in 1.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:43 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7 Nov 05 08:21:43 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:43 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3716c94e-6584-4a61-a3b4-6254918e29b7" returned: 0 in 0.980s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "cinder-quobyte-3716c94e-6584-4a61-a3b4-6254918e29b7" released by "delete_volume" :: held 5.133s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:21:44 devstack cinder-volume[87092]: WARNING cinder.quota [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:21:44 devstack cinder-volume[87092]: WARNING cinder.quota [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Created reservations ['3d6f6d60-f0a5-46a0-be1c-3cee5ef90fa9', '89f1ec6e-0190-4a48-9ed9-e9a60a441a5c', '3e04bb8a-6186-4b24-9c6e-9dcb03c08c31', '18bbd0c7-578a-4793-b6af-a0e7dade892a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:44 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:21:44 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:45 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.725s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:45 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:21:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Deleted volume successfully. Nov 05 08:21:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-06da662f-faec-4b90-8c6b-2618516c8449 tempest-VolumesAdminNegativeTest-1059348253 None] Lock "cinder-3716c94e-6584-4a61-a3b4-6254918e29b7-delete_volume" released by "delete_volume" :: held 6.755s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Flow 'volume_create_manager' (5d346dd0-29fb-4d1e-90ad-a4ad511cd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1531864d-2ae7-4d95-982a-068b6e1dee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1531864d-2ae7-4d95-982a-068b6e1dee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1290422082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed221e9784430d86a25aefb379a27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:49Z,use_quota=True,user_id='286a4caf19554c12a98601c57b3dbf89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb634a-1f49-41ce-afbb-84552d14f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cb634a-1f49-41ce-afbb-84552d14f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ad7c24-8df8-438e-b462-9225ab2e36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ad7c24-8df8-438e-b462-9225ab2e36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98', 'volume_name': 'volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df9f24b-d3b5-4474-a1e7-3acbe9e878b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df9f24b-d3b5-4474-a1e7-3acbe9e878b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4996e9a7-be50-4068-928a-0c167be90af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Volume 5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98', 'volume_size': 1} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1290422082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed221e9784430d86a25aefb379a27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:49Z,use_quota=True,user_id='286a4caf19554c12a98601c57b3dbf89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Creating volume 5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:49 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:49 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 1073741824 Nov 05 08:21:49 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:49 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 1073741824" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:49 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 Nov 05 08:21:49 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:50 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4996e9a7-be50-4068-928a-0c167be90af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70460f8-5ab7-412c-8fc1-a5eeefad7d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Volume volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 (5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98): created successfully Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70460f8-5ab7-412c-8fc1-a5eeefad7d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Flow 'volume_create_manager' (5d346dd0-29fb-4d1e-90ad-a4ad511cd48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-abfadec0-3473-4429-8093-3c98ceecb42d tempest-ServersNegativeTestJSON-478552237 None] Created volume successfully. Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Flow 'volume_create_manager' (db249a77-9ffc-4701-a9a7-554dcd9237cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b9696e-a157-484b-b03e-e354c9097964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b9696e-a157-484b-b03e-e354c9097964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1446072861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e743781-f0df-4af4-9fe0-4ee17449164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed221e9784430d86a25aefb379a27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:57Z,use_quota=True,user_id='286a4caf19554c12a98601c57b3dbf89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5e43e-7f82-4be0-8b59-1b66ca6b4e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f5e43e-7f82-4be0-8b59-1b66ca6b4e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563421be-acf5-443c-b803-a81357542921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563421be-acf5-443c-b803-a81357542921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e743781-f0df-4af4-9fe0-4ee17449164d', 'volume_name': 'volume-6e743781-f0df-4af4-9fe0-4ee17449164d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1041b4-5e0b-47dc-8b36-f081e7327268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1041b4-5e0b-47dc-8b36-f081e7327268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3967996-9d1b-4b9e-a0cb-ac404763c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Volume 6e743781-f0df-4af4-9fe0-4ee17449164d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e743781-f0df-4af4-9fe0-4ee17449164d', 'volume_size': 1} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1446072861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e743781-f0df-4af4-9fe0-4ee17449164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbed221e9784430d86a25aefb379a27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:21:57Z,use_quota=True,user_id='286a4caf19554c12a98601c57b3dbf89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Creating volume 6e743781-f0df-4af4-9fe0-4ee17449164d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:21:57 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:57 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d 1073741824 Nov 05 08:21:57 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:57 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d 1073741824" returned: 0 in 0.622s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:21:57 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d Nov 05 08:21:57 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:21:58 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3967996-9d1b-4b9e-a0cb-ac404763c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e743781-f0df-4af4-9fe0-4ee17449164d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb476303-8521-400e-9561-cb9c8088d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:21:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Volume volume-6e743781-f0df-4af4-9fe0-4ee17449164d (6e743781-f0df-4af4-9fe0-4ee17449164d): created successfully Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb476303-8521-400e-9561-cb9c8088d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:21:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Flow 'volume_create_manager' (db249a77-9ffc-4701-a9a7-554dcd9237cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:21:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-960a31c5-4761-477d-bc02-b6d155034101 tempest-ServersNegativeTestJSON-478552237 None] Created volume successfully. Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "cinder-6e743781-f0df-4af4-9fe0-4ee17449164d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-6e743781-f0df-4af4-9fe0-4ee17449164d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "cinder-quobyte-6e743781-f0df-4af4-9fe0-4ee17449164d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-quobyte-6e743781-f0df-4af4-9fe0-4ee17449164d" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3597f52e-eab8-46c7-93be-f13529aa76cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:00 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d Nov 05 08:22:00 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:00 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d" returned: 0 in 0.563s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:00 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d Nov 05 08:22:00 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:01 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e743781-f0df-4af4-9fe0-4ee17449164d" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-quobyte-6e743781-f0df-4af4-9fe0-4ee17449164d" released by "delete_volume" :: held 0.928s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Created reservations ['dbfa045a-89fc-4f27-957e-c333c5cf0977', '203f92de-2e69-4c48-b3ba-9be2e985781e', '53b8eb3b-d999-4f2f-99cb-016720edf228', '330cf3a6-93b7-4e9f-b1f9-d00aea2cf213'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:01 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:01 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:01 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Deleted volume successfully. Nov 05 08:22:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86845bcd-586c-453c-bfd1-7e22e8b40b1d tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-6e743781-f0df-4af4-9fe0-4ee17449164d-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "cinder-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "cinder-quobyte-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-quobyte-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e43f6-950c-4428-b6c9-1a9574f0369d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:02 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 Nov 05 08:22:02 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:03 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:03 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98 Nov 05 08:22:03 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:03 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-quobyte-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98" released by "delete_volume" :: held 0.862s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Created reservations ['c914c381-4f8d-46df-be1b-04bbb0ffbcaf', 'a114afd6-8033-43bd-b44b-0173230e6620', '05ac7109-c404-4dce-81b5-208f62f0d2a3', '811f39c3-51a1-4081-8fc3-c9f25f7928d8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:03 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:03 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:03 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Deleted volume successfully. Nov 05 08:22:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9d7963f-bf03-4965-9035-095360e9d733 tempest-ServersNegativeTestJSON-478552237 None] Lock "cinder-5b6855fb-fdf8-4e7f-89f7-5bc1d7367a98-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:13 devstack cinder-volume[87092]: WARNING py.warnings [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 05 08:22:13 devstack cinder-volume[87092]: .first() Nov 05 08:22:13 devstack cinder-volume[87092]: Nov 05 08:22:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac104152-f845-4063-b0f5-7a0dd3008f47', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:22:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-96792865-8e1c-45e8-adc9-32ed2f9f326b req-a63a1862-044c-4ad7-b60f-c196ed93ae07 tempest-TaggedAttachmentsTest-398327662 None] attachment_update completed successfully. Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:18 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:18 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:18 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-d9addfb3-77d7-4b1c-952c-974244c64ed1 req-e8eee2a1-b43b-40f8-9fe3-c78602c9f921 tempest-TaggedAttachmentsTest-398327662 None] Terminate volume connection completed successfully. Nov 05 08:22:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-d9addfb3-77d7-4b1c-952c-974244c64ed1 req-e8eee2a1-b43b-40f8-9fe3-c78602c9f921 tempest-TaggedAttachmentsTest-398327662 None] Deleting attachment ac104152-f845-4063-b0f5-7a0dd3008f47. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:22:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Flow 'volume_create_manager' (b5df306a-ac1f-4701-9f2f-e9b2fc1a991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3e6287-b827-44cc-91f1-514b17faea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3e6287-b827-44cc-91f1-514b17faea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-814209521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3437dbc-0354-4369-a96f-996146f958b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23c1c7ad992d40daaeb79f9052cf2c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:23Z,use_quota=True,user_id='4e47c432a680474ca43b8b8857088a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a4b6df-dfb3-4995-a27b-c027c317446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a4b6df-dfb3-4995-a27b-c027c317446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db33c6e-5587-483d-b51a-8ed2b57abbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db33c6e-5587-483d-b51a-8ed2b57abbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3437dbc-0354-4369-a96f-996146f958b9', 'volume_name': 'volume-a3437dbc-0354-4369-a96f-996146f958b9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb00cdd-450f-4cf7-af4e-275288888524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb00cdd-450f-4cf7-af4e-275288888524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7e6e11-aeee-42e1-81aa-f3a8a05af0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Volume a3437dbc-0354-4369-a96f-996146f958b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3437dbc-0354-4369-a96f-996146f958b9', 'volume_size': 1} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-814209521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3437dbc-0354-4369-a96f-996146f958b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='23c1c7ad992d40daaeb79f9052cf2c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:23Z,use_quota=True,user_id='4e47c432a680474ca43b8b8857088a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Creating volume a3437dbc-0354-4369-a96f-996146f958b9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:23 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 1073741824 Nov 05 08:22:23 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:23 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 1073741824" returned: 0 in 0.691s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:23 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 Nov 05 08:22:23 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:24 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7e6e11-aeee-42e1-81aa-f3a8a05af0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3437dbc-0354-4369-a96f-996146f958b9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf215c5-2695-4e9c-8f28-dd8b2d5f6e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Volume volume-a3437dbc-0354-4369-a96f-996146f958b9 (a3437dbc-0354-4369-a96f-996146f958b9): created successfully Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf215c5-2695-4e9c-8f28-dd8b2d5f6e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Flow 'volume_create_manager' (b5df306a-ac1f-4701-9f2f-e9b2fc1a991c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-9bbde7a9-4d28-4850-b95c-7695db9d6d9d req-2666e6eb-51ab-4404-9b3e-0bdcdcc53ebe tempest-VolumesGetTestJSON-1481354196 None] Created volume successfully. Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Acquiring lock "cinder-a3437dbc-0354-4369-a96f-996146f958b9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "cinder-a3437dbc-0354-4369-a96f-996146f958b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Acquiring lock "cinder-quobyte-a3437dbc-0354-4369-a96f-996146f958b9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "cinder-quobyte-a3437dbc-0354-4369-a96f-996146f958b9" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df19ac1-0285-4033-80e8-b50b51ae2a9e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:25 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 Nov 05 08:22:25 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:26 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:26 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9 Nov 05 08:22:26 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:26 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a3437dbc-0354-4369-a96f-996146f958b9" returned: 0 in 0.529s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "cinder-quobyte-a3437dbc-0354-4369-a96f-996146f958b9" released by "delete_volume" :: held 1.141s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:26 devstack cinder-volume[87092]: DEBUG cinder.quota [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Created reservations ['f6a90df0-d26a-41d3-9dce-6a2a747d8f8c', '5ee7fa7f-f488-45af-9c6b-627be8896d0f', '1e0fba88-5f6c-4e90-a3b6-73e8d327fef2', 'fdfe71db-fa2e-44e5-90c3-695d3578740a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:27 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:27 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:27 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG cinder.manager [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Deleted volume successfully. Nov 05 08:22:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-a321536d-9af3-43af-b6df-1ac5d6b366c4 req-6793cb0e-9154-49ca-90b6-6e06f8ffca06 tempest-VolumesGetTestJSON-1481354196 None] Lock "cinder-a3437dbc-0354-4369-a96f-996146f958b9-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "cinder-bb0067e9-6f16-4ea8-9c1b-174c2d933096-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "cinder-bb0067e9-6f16-4ea8-9c1b-174c2d933096-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "cinder-quobyte-bb0067e9-6f16-4ea8-9c1b-174c2d933096" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "cinder-quobyte-bb0067e9-6f16-4ea8-9c1b-174c2d933096" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d245b7-1377-4f8f-b702-1272c519418e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:32 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 Nov 05 08:22:32 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (d8ce90ab-5817-46ac-b701-d79e2ed5cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a1233-16d9-4440-b4cc-b6cb6b9a55cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a1233-16d9-4440-b4cc-b6cb6b9a55cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-980428288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970988b8-99b1-4195-9444-8269b50a46cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:33Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7106f7d1-6d0b-4c71-97f2-e3e02f3dd3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7106f7d1-6d0b-4c71-97f2-e3e02f3dd3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a22c28-ba2c-4122-bd6a-4ceaa49dfa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a22c28-ba2c-4122-bd6a-4ceaa49dfa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970988b8-99b1-4195-9444-8269b50a46cb', 'volume_name': 'volume-970988b8-99b1-4195-9444-8269b50a46cb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e7513c-4dae-4e3c-a269-efa1b648cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e7513c-4dae-4e3c-a269-efa1b648cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2065dfec-bcb4-41ce-88bb-68acc1ec4e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Volume 970988b8-99b1-4195-9444-8269b50a46cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970988b8-99b1-4195-9444-8269b50a46cb', 'volume_size': 1} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-980428288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970988b8-99b1-4195-9444-8269b50a46cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:33Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Creating volume 970988b8-99b1-4195-9444-8269b50a46cb {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:32 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:32 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:33 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb 1073741824 Nov 05 08:22:33 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:33 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096 Nov 05 08:22:33 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:33 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb0067e9-6f16-4ea8-9c1b-174c2d933096" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "cinder-quobyte-bb0067e9-6f16-4ea8-9c1b-174c2d933096" released by "delete_volume" :: held 0.748s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=41,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=40,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Created reservations ['97af65eb-c1b0-4b7a-95cd-5ce1b296264d', '775c1588-b3ee-4d6b-bc5d-4c7385b978cf', '704d8777-9b76-41ae-b93d-a8ffc5729e50', 'f33ac3bc-b6e5-4707-99ec-94c753f8700b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:33 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:33 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:33 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb 1073741824" returned: 0 in 0.660s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:33 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb Nov 05 08:22:33 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:33 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Deleted volume successfully. Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-04c3fa88-c99e-4423-8684-076cbb182d0a tempest-TaggedAttachmentsTest-398327662 None] Lock "cinder-bb0067e9-6f16-4ea8-9c1b-174c2d933096-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:34 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2065dfec-bcb4-41ce-88bb-68acc1ec4e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970988b8-99b1-4195-9444-8269b50a46cb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca9cb0d-a3e5-454d-ac1b-57c7c86eac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:34 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Volume volume-970988b8-99b1-4195-9444-8269b50a46cb (970988b8-99b1-4195-9444-8269b50a46cb): created successfully Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca9cb0d-a3e5-454d-ac1b-57c7c86eac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (d8ce90ab-5817-46ac-b701-d79e2ed5cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e3b02f08-7fb9-460a-aa83-7dec93136a2b tempest-VolumesTestJSON-1670693697 None] Created volume successfully. Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (23c78641-9984-4d41-94c8-5ee5341dcfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3a5d3-e91e-4802-a168-023694030a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3a5d3-e91e-4802-a168-023694030a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-878839821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d0dac7-0828-4450-8f97-75532b66632c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:36Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75aee42a-029c-44dc-bfda-b9ed1934a462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75aee42a-029c-44dc-bfda-b9ed1934a462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647198b0-f92d-47df-a707-9ab486cfd3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647198b0-f92d-47df-a707-9ab486cfd3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d0dac7-0828-4450-8f97-75532b66632c', 'volume_name': 'volume-d3d0dac7-0828-4450-8f97-75532b66632c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea99d690-574f-4d09-bf42-4707e2431bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea99d690-574f-4d09-bf42-4707e2431bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57321d69-fbab-4c14-95ac-647f12a4d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Volume d3d0dac7-0828-4450-8f97-75532b66632c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d0dac7-0828-4450-8f97-75532b66632c', 'volume_size': 1} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-878839821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d0dac7-0828-4450-8f97-75532b66632c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:36Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Creating volume d3d0dac7-0828-4450-8f97-75532b66632c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:36 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:36 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c 1073741824 Nov 05 08:22:36 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:36 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c 1073741824" returned: 0 in 0.566s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:36 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c Nov 05 08:22:36 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:36 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57321d69-fbab-4c14-95ac-647f12a4d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d0dac7-0828-4450-8f97-75532b66632c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c505d-b37a-4565-adc7-eda193bb846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Volume volume-d3d0dac7-0828-4450-8f97-75532b66632c (d3d0dac7-0828-4450-8f97-75532b66632c): created successfully Nov 05 08:22:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c505d-b37a-4565-adc7-eda193bb846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (23c78641-9984-4d41-94c8-5ee5341dcfe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-14cd7b69-af35-4ab2-a4c8-0384a72cea3b tempest-VolumesTestJSON-1670693697 None] Created volume successfully. Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (56d38c9a-e046-4ae6-b4a3-a38c7e66d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de24fd01-016a-447b-9fb8-0baba0152740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de24fd01-016a-447b-9fb8-0baba0152740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-412612173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227a95af-c35f-4ed7-8607-235502af0d35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:39Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0663a4-baf9-4a54-85dc-23a822c4c1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0663a4-baf9-4a54-85dc-23a822c4c1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc7c24b-b4b9-4cdb-87bd-041e34ebee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc7c24b-b4b9-4cdb-87bd-041e34ebee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227a95af-c35f-4ed7-8607-235502af0d35', 'volume_name': 'volume-227a95af-c35f-4ed7-8607-235502af0d35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4209ec-d1e8-40b4-bb6c-a5d939db24cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4209ec-d1e8-40b4-bb6c-a5d939db24cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ff3963-eed8-4d11-9a53-6ac0b8046064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Volume 227a95af-c35f-4ed7-8607-235502af0d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227a95af-c35f-4ed7-8607-235502af0d35', 'volume_size': 1} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-412612173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227a95af-c35f-4ed7-8607-235502af0d35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39199d7265c4401db2ffcb511313f550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:39Z,use_quota=True,user_id='5e987ad05d484324991f79db0cc87299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Creating volume 227a95af-c35f-4ed7-8607-235502af0d35 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:39 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 1073741824 Nov 05 08:22:39 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Flow 'volume_create_manager' (68a3cef2-24ba-41ce-b679-afdcfb29a413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b00232-316d-4275-8db7-7375bc32f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b00232-316d-4275-8db7-7375bc32f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-464892821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69d5218-5a5c-471b-9114-2a4ed0fc4ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df5ee79cf534195a7ff6f7ab7644b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:40Z,use_quota=True,user_id='a69a2ff0de904f5f9d932fb114c67e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c0aa7e-000e-4553-8134-d40448c863a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c0aa7e-000e-4553-8134-d40448c863a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d7e040-fdc0-468a-9601-1800cd958e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d7e040-fdc0-468a-9601-1800cd958e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'volume_name': 'volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6a613f-a4b0-4477-9ae9-f85c5be3c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6a613f-a4b0-4477-9ae9-f85c5be3c63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6e1a25-832e-47d4-8de8-a0d714f960cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Volume b69d5218-5a5c-471b-9114-2a4ed0fc4ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'volume_size': 1} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:40 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 1073741824" returned: 0 in 1.170s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:40 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 Nov 05 08:22:40 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:41 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-464892821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69d5218-5a5c-471b-9114-2a4ed0fc4ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df5ee79cf534195a7ff6f7ab7644b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:40Z,use_quota=True,user_id='a69a2ff0de904f5f9d932fb114c67e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Creating volume b69d5218-5a5c-471b-9114-2a4ed0fc4ebc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:41 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ff3963-eed8-4d11-9a53-6ac0b8046064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227a95af-c35f-4ed7-8607-235502af0d35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553d5b41-e21d-47f6-9a4b-eff6ab551236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:41 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc 1073741824 Nov 05 08:22:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Volume volume-227a95af-c35f-4ed7-8607-235502af0d35 (227a95af-c35f-4ed7-8607-235502af0d35): created successfully Nov 05 08:22:41 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553d5b41-e21d-47f6-9a4b-eff6ab551236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Flow 'volume_create_manager' (56d38c9a-e046-4ae6-b4a3-a38c7e66d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-46457a1a-53b5-48c1-b3aa-49a14abf22a2 tempest-VolumesTestJSON-1670693697 None] Created volume successfully. Nov 05 08:22:42 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc 1073741824" returned: 0 in 0.772s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:42 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc Nov 05 08:22:42 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:42 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6e1a25-832e-47d4-8de8-a0d714f960cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bf2e11-1a52-44d9-b476-75e5b5d243af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Volume volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc (b69d5218-5a5c-471b-9114-2a4ed0fc4ebc): created successfully Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bf2e11-1a52-44d9-b476-75e5b5d243af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Flow 'volume_create_manager' (68a3cef2-24ba-41ce-b679-afdcfb29a413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-abd7df22-0088-410e-aa53-537ef3ea0fe3 tempest-ServerActionsTestOtherA-1368412897 None] Created volume successfully. Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-227a95af-c35f-4ed7-8607-235502af0d35-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-227a95af-c35f-4ed7-8607-235502af0d35-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-quobyte-227a95af-c35f-4ed7-8607-235502af0d35" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-227a95af-c35f-4ed7-8607-235502af0d35" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedff8a8-5fb2-43b1-ab25-b10422f80bd3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:44 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 Nov 05 08:22:44 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:45 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Flow 'volume_create_manager' (1720cf48-a193-4546-a67c-eb6e68b2422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add17acf-0559-400d-b303-3f7a868b2624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35" returned: 0 in 0.681s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add17acf-0559-400d-b303-3f7a868b2624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1219921778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6327e07e-3da6-4ee2-a8fc-d2dbc80665cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604d31f699194e61bc62d85743cc1823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:45Z,use_quota=True,user_id='56dfbeb8374d48a29e2293ca16ca362e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ee1e3a-50bf-4a1c-94ad-5a3922b23358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ee1e3a-50bf-4a1c-94ad-5a3922b23358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:45 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35 Nov 05 08:22:45 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad94cbc-497c-411f-bbd6-93335b1e370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad94cbc-497c-411f-bbd6-93335b1e370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6327e07e-3da6-4ee2-a8fc-d2dbc80665cb', 'volume_name': 'volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2af3d-ec94-42c0-b369-b2032db10803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2af3d-ec94-42c0-b369-b2032db10803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2b168d-8014-4fb7-821f-f5606e8831d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Volume 6327e07e-3da6-4ee2-a8fc-d2dbc80665cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb', 'volume_size': 1} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1219921778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6327e07e-3da6-4ee2-a8fc-d2dbc80665cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604d31f699194e61bc62d85743cc1823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:22:45Z,use_quota=True,user_id='56dfbeb8374d48a29e2293ca16ca362e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Creating volume 6327e07e-3da6-4ee2-a8fc-d2dbc80665cb {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:22:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:45 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb 1073741824 Nov 05 08:22:45 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:45 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-227a95af-c35f-4ed7-8607-235502af0d35" returned: 0 in 0.649s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-227a95af-c35f-4ed7-8607-235502af0d35" released by "delete_volume" :: held 1.419s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Created reservations ['31c4f99e-fb2f-4acd-b49c-5458d5069f14', 'f9f4a2b3-0440-4515-8ad8-f0dd037a774e', 'a5002051-3c07-4863-9776-13fe6d0ebda8', 'b7fe8ef5-fccc-495e-908a-f02b3103c336'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:46 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:46 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:46 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb 1073741824" returned: 0 in 0.918s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:46 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb Nov 05 08:22:46 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:46 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.493s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Deleted volume successfully. Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e3495165-ad16-4c99-a5ec-570956133e05 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-227a95af-c35f-4ed7-8607-235502af0d35-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-d3d0dac7-0828-4450-8f97-75532b66632c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "cinder-d3d0dac7-0828-4450-8f97-75532b66632c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-quobyte-d3d0dac7-0828-4450-8f97-75532b66632c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:46 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" returned: 0 in 0.519s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-d3d0dac7-0828-4450-8f97-75532b66632c" acquired by "delete_volume" :: waited 0.066s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2b168d-8014-4fb7-821f-f5606e8831d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7cd475-6c88-419e-b886-895cac14c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f3d18-9e56-4f22-992b-dd9cc3305a03]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Volume volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb (6327e07e-3da6-4ee2-a8fc-d2dbc80665cb): created successfully Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7cd475-6c88-419e-b886-895cac14c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Flow 'volume_create_manager' (1720cf48-a193-4546-a67c-eb6e68b2422a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:22:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5cd2e4a2-f282-49e4-a1bf-d3440eaf68e8 tempest-DeleteServersTestJSON-871760888 None] Created volume successfully. Nov 05 08:22:47 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c Nov 05 08:22:47 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:47 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c" returned: 0 in 0.811s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:47 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c Nov 05 08:22:47 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:48 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3d0dac7-0828-4450-8f97-75532b66632c" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-d3d0dac7-0828-4450-8f97-75532b66632c" released by "delete_volume" :: held 1.405s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Created reservations ['1e5c8363-96af-4b57-b8b0-f120528f55aa', '154e93f1-199c-406f-bf99-7238634f2c25', '48434e29-f472-471b-9835-9fc6371979c1', 'cc0aa1df-ed89-4873-9532-79d4fa215777'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:48 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:48 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:49 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.560s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Deleted volume successfully. Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-91aca518-f1a7-4198-94a3-4f33c6403e7a tempest-VolumesTestJSON-1670693697 None] Lock "cinder-d3d0dac7-0828-4450-8f97-75532b66632c-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-970988b8-99b1-4195-9444-8269b50a46cb-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-970988b8-99b1-4195-9444-8269b50a46cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "cinder-quobyte-970988b8-99b1-4195-9444-8269b50a46cb" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-970988b8-99b1-4195-9444-8269b50a46cb" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740bfff-054f-48e2-a4dd-c13de9b6105b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:22:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:49 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb Nov 05 08:22:49 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:50 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb" returned: 0 in 0.613s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:50 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb Nov 05 08:22:50 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fc5f12be-9edb-401f-93a8-c6c778d20469 req-0436dde0-b61a-41ba-94e4-97eaaa4836fe tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fc5f12be-9edb-401f-93a8-c6c778d20469 req-0436dde0-b61a-41ba-94e4-97eaaa4836fe tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-fc5f12be-9edb-401f-93a8-c6c778d20469 req-0436dde0-b61a-41ba-94e4-97eaaa4836fe tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-fc5f12be-9edb-401f-93a8-c6c778d20469 req-0436dde0-b61a-41ba-94e4-97eaaa4836fe tempest-DeleteServersTestJSON-871760888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b121078-e300-4922-bc1c-bb4d59b5bcea', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:22:50 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-970988b8-99b1-4195-9444-8269b50a46cb" returned: 0 in 0.648s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-quobyte-970988b8-99b1-4195-9444-8269b50a46cb" released by "delete_volume" :: held 1.344s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-fc5f12be-9edb-401f-93a8-c6c778d20469 req-0436dde0-b61a-41ba-94e4-97eaaa4836fe tempest-DeleteServersTestJSON-871760888 None] attachment_update completed successfully. Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Created reservations ['d33afdf5-99c8-49e4-8c74-6db1e57758e2', '0e4b1404-14af-4b37-bb78-4bcf868ded13', '612c127d-eccf-4b47-aeb9-4a7206a95540', '3bfef679-79d1-48cc-aede-718c8e1d197b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:22:51 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:22:51 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:22:51 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:22:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Deleted volume successfully. Nov 05 08:22:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-615e41d5-0e1a-47b0-903e-275b09ae6a23 tempest-VolumesTestJSON-1670693697 None] Lock "cinder-970988b8-99b1-4195-9444-8269b50a46cb-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:22:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c247943e-4324-41da-b6ee-f0ab0f05ee7e req-1c093da9-0e5c-4a49-9d10-6d426f07d474 tempest-DeleteServersTestJSON-871760888 None] Terminate volume connection completed successfully. Nov 05 08:22:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c247943e-4324-41da-b6ee-f0ab0f05ee7e req-1c093da9-0e5c-4a49-9d10-6d426f07d474 tempest-DeleteServersTestJSON-871760888 None] Deleting attachment 5b121078-e300-4922-bc1c-bb4d59b5bcea. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:23:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d284c57e-d3ea-4b35-8cb4-4273c534eb9c tempest-BackendsCapabilitiesAdminTestsJSON-750127817 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:23:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-159e4a37-007c-43ee-ab61-c234049f43dc tempest-BackendsCapabilitiesAdminTestsJSON-750127817 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "cinder-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "cinder-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "cinder-quobyte-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "cinder-quobyte-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[78709944-2372-457a-ad7e-800ded5f3ff7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:02 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb Nov 05 08:23:02 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:02 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:02 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb Nov 05 08:23:02 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:03 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "cinder-quobyte-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb" released by "delete_volume" :: held 0.971s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Created reservations ['a8e88723-8e2e-48d0-8bed-2a92deac35bd', '2af5d063-d7fb-4224-824a-1a24c38f6812', '2a3fdbd2-82ba-4179-b9d7-d9d4b10070d2', '846bd7d0-2209-4735-b6c5-fecbbd81e540'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:03 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:23:03 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:03 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Deleted volume successfully. Nov 05 08:23:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-470c3c55-10c1-4f68-b546-8e62f45490a8 tempest-DeleteServersTestJSON-871760888 None] Lock "cinder-6327e07e-3da6-4ee2-a8fc-d2dbc80665cb-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=41,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:23:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=38,cinder:INSERT=10,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:23:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96861891-1728-47e6-8798-bd3e318b35d5 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-1963807747: creating Nov 05 08:23:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96861891-1728-47e6-8798-bd3e318b35d5 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-1963807747: created successfully Nov 05 08:23:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96861891-1728-47e6-8798-bd3e318b35d5 tempest-GroupSnapshotsTest-1643865215 None] Create group completed successfully. Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (7210267c-ed02-4496-b22e-6313d3eb58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242701e1-a6f6-457c-8f9e-10d60e92c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242701e1-a6f6-457c-8f9e-10d60e92c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917223424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08a5b950-a071-4956-af71-a370f30f9317,host='devstack@QuobyteHD#QuobyteHD',id=c2b5734e-bcac-4f35-b71a-51d59708fddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:17Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebd52ac9-e1e1-437f-ac84-c2f30fc6376d),volume_type_id=ebd52ac9-e1e1-437f-ac84-c2f30fc6376d)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f067fd53-b144-4013-a0b1-a26ae67298de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f067fd53-b144-4013-a0b1-a26ae67298de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176c686-ba55-4fc2-bd60-a17733e0b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176c686-ba55-4fc2-bd60-a17733e0b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b5734e-bcac-4f35-b71a-51d59708fddb', 'volume_name': 'volume-c2b5734e-bcac-4f35-b71a-51d59708fddb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a86782-64cb-483a-8fd4-c3cc15f10ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a86782-64cb-483a-8fd4-c3cc15f10ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea750d9-767b-431c-889e-0d40b9d56714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Volume c2b5734e-bcac-4f35-b71a-51d59708fddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b5734e-bcac-4f35-b71a-51d59708fddb', 'volume_size': 1} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08a5b950-a071-4956-af71-a370f30f9317,created_at=2026-11-05T07:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917223424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08a5b950-a071-4956-af71-a370f30f9317,host='devstack@QuobyteHD#QuobyteHD',id=c2b5734e-bcac-4f35-b71a-51d59708fddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:17Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebd52ac9-e1e1-437f-ac84-c2f30fc6376d),volume_type_id=ebd52ac9-e1e1-437f-ac84-c2f30fc6376d)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Creating volume c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:23:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:17 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb 1073741824 Nov 05 08:23:17 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:18 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb 1073741824" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:18 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:18 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:18 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:23:18 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:18 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea750d9-767b-431c-889e-0d40b9d56714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b5734e-bcac-4f35-b71a-51d59708fddb', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092185f-097c-4d9e-94d4-54e957d72c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Volume volume-c2b5734e-bcac-4f35-b71a-51d59708fddb (c2b5734e-bcac-4f35-b71a-51d59708fddb): created successfully Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a092185f-097c-4d9e-94d4-54e957d72c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (7210267c-ed02-4496-b22e-6313d3eb58e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-090664d0-e685-4379-bcfc-500547da77fb tempest-GroupSnapshotsTest-1643865215 None] Created volume successfully. Nov 05 08:23:18 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 8 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:23:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:23:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] GroupSnapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: creating. Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Group snapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Creating offline snapshot 41de5ad7-4caf-4dc4-a806-a09d7790730d of volume c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecd76af-311e-449d-979f-54dced846884]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:20 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:20 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:21 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 0.467s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:21 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d 1G Nov 05 08:23:21 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:21 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d 1G" returned: 0 in 0.583s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b5734e-bcac-4f35-b71a-51d59708fddb -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:21 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b5734e-bcac-4f35-b71a-51d59708fddb -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:21 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:22 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2b5734e-bcac-4f35-b71a-51d59708fddb -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.580s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:22 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:23:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:22 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:22 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:22 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:22 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info Nov 05 08:23:22 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-53a81e50-a5a8-4069-8d91-232fc0dfac04 req-de9b52b9-84b4-426a-bdc8-c469d0ccdefa tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:23 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:23 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:23 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info Nov 05 08:23:23 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:23 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.925s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-53a81e50-a5a8-4069-8d91-232fc0dfac04 req-de9b52b9-84b4-426a-bdc8-c469d0ccdefa tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-53a81e50-a5a8-4069-8d91-232fc0dfac04 req-de9b52b9-84b4-426a-bdc8-c469d0ccdefa tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-53a81e50-a5a8-4069-8d91-232fc0dfac04 req-de9b52b9-84b4-426a-bdc8-c469d0ccdefa tempest-ServerActionsTestOtherA-1368412897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7371b79c-963a-47e4-88aa-e40bd56fe673', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:23:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8876db41-a7b8-47e4-a3d7-246e8b72f864 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: created successfully Nov 05 08:23:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-53a81e50-a5a8-4069-8d91-232fc0dfac04 req-de9b52b9-84b4-426a-bdc8-c469d0ccdefa tempest-ServerActionsTestOtherA-1368412897 None] attachment_update completed successfully. Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d-257159e3-6a58-425a-b264-b9462a8fe57c" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d-257159e3-6a58-425a-b264-b9462a8fe57c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Creating volume 257159e3-6a58-425a-b264-b9462a8fe57c from snapshot 41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] snapshot: 41de5ad7-4caf-4dc4-a806-a09d7790730d, volume: 257159e3-6a58-425a-b264-b9462a8fe57c, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c025b-1fc2-4e9c-ad96-fec803029735]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:25 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:25 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:26 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.572s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2b5734e-bcac-4f35-b71a-51d59708fddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f46da-a518-4959-98c2-6f2bcaeb2eff]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:26 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:26 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:26 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:23:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:26 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c Nov 05 08:23:26 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-0532d795-3e55-4b8a-aa94-4001300fe105 tempest-ServerActionsTestOtherA-1368412897 None] Terminate volume connection completed successfully. Nov 05 08:23:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-0532d795-3e55-4b8a-aa94-4001300fe105 tempest-ServerActionsTestOtherA-1368412897 None] Deleting attachment 7371b79c-963a-47e4-88aa-e40bd56fe673. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:23:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-834d2e86-dfe6-4768-95cc-aa70147c1a3c tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:38 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c" returned: 0 in 11.650s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb, size 1024.00 MB, duration 11.65 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:23:38 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Converted 1024.00 MB image at 87.89 MB/s Nov 05 08:23:38 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:38 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c Nov 05 08:23:38 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:38 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" released by "_copy_volume_from_snapshot" :: held 13.072s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d-257159e3-6a58-425a-b264-b9462a8fe57c" released by "_create_volume_from_snapshot" :: held 13.162s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.194s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-834d2e86-dfe6-4768-95cc-aa70147c1a3c tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.974s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-834d2e86-dfe6-4768-95cc-aa70147c1a3c tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-834d2e86-dfe6-4768-95cc-aa70147c1a3c tempest-ServerActionsTestOtherA-1368412897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5aba960-adba-428d-99eb-9ec3fcecc1f2', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:23:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22d21482-5295-4e37-9e53-d0bbc1cdd73b tempest-GroupSnapshotsTest-1643865215 None] Create group from source-snapshot-efa94ae0-98e5-462a-a26c-5f8f019da9da completed successfully. Nov 05 08:23:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-dc0d835b-2295-40a9-8c65-555c4ab9ba42 req-834d2e86-dfe6-4768-95cc-aa70147c1a3c tempest-ServerActionsTestOtherA-1368412897 None] attachment_update completed successfully. Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce71cde-a38c-49d2-8d7b-5038533847a0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:40 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c Nov 05 08:23:40 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:40 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c" returned: 0 in 0.709s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:41 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c Nov 05 08:23:41 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:41 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-257159e3-6a58-425a-b264-b9462a8fe57c" returned: 0 in 0.570s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-257159e3-6a58-425a-b264-b9462a8fe57c" released by "delete_volume" :: held 1.378s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['33196083-76e8-40d9-9446-79d2da3059a9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1351235585 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1351235585, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:23:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1351235585 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1351235585, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['6b1d4c1b-7a7e-468d-8f42-f4f820cf7fb6', 'c8717294-4045-463c-88d2-5a966fe3ada2', '6cad0536-bcb4-42a7-a882-f6be44ad11b6', '6674942a-4769-4335-a2d0-4984ae0dd38b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:41 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:23:41 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:42 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-97ceda65-0f04-4a63-b97b-82f94f9981e0 tempest-GroupSnapshotsTest-1643865215 None] Delete group completed successfully. Nov 05 08:23:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: deleting Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Deleting offline snapshot 41de5ad7-4caf-4dc4-a806-a09d7790730d of volume c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] snapshot_file for this snap is: volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa77767-7000-4f84-a438-dfb1ead68d98]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:43 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:43 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:44 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.920s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2b5734e-bcac-4f35-b71a-51d59708fddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:23:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd791a-c336-4e54-a443-23bd00821315]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:44 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:44 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:45 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 0.857s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:45 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:45 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:45 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.565s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:45 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d Nov 05 08:23:45 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:46 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb.41de5ad7-4caf-4dc4-a806-a09d7790730d" returned: 0 in 0.642s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-41de5ad7-4caf-4dc4-a806-a09d7790730d" released by "_delete_snapshot" :: held 3.356s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" released by "delete_snapshot" :: held 3.444s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:46 devstack cinder-volume[87092]: WARNING cinder.quota [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1351235585 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1351235585, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:23:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['0b27b146-1d77-4189-be2b-852da337e7bb', '139c33d1-d560-4e1b-95dc-42800b6da2b1', '8b1473a3-0f98-4f6f-9c10-ebe298c7d20c', '07d94b3f-4600-4b4c-a5cf-a80b4a315a64'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d57038a7-1d1d-4436-aa89-52ab3a80cbb9 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot efa94ae0-98e5-462a-a26c-5f8f019da9da: deleted successfully Nov 05 08:23:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:23:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" acquired by "delete_volume" :: waited 0.065s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:23:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a739452-5493-4700-9c70-fa9ac5dc881a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:23:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:48 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:48 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:49 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 0.980s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:49 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb Nov 05 08:23:49 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:50 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c2b5734e-bcac-4f35-b71a-51d59708fddb" returned: 0 in 1.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-c2b5734e-bcac-4f35-b71a-51d59708fddb" released by "delete_volume" :: held 2.723s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['6b6e708a-97ff-4d32-9c16-8232664a7f86'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:51 devstack cinder-volume[87092]: WARNING cinder.db.api [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1351235585'] Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['82a3d543-0334-4e79-aced-c0e6e9b0fba0', 'e4be781c-cb8d-424c-abdc-78bed76695f1', '6893887d-773b-4066-a5b2-fddd731712cb', '25ab4bb4-e2f5-4f7d-89ba-8d22430139c6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:51 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:23:51 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:52 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.619s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:23:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a01db56e-8841-4411-a326-282f1507544e tempest-GroupSnapshotsTest-1643865215 None] Delete group completed successfully. Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (24410c3e-3aca-40bc-ab7c-9f5d657bc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085ebcf-2d10-40a1-84c1-101d0e88a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1085ebcf-2d10-40a1-84c1-101d0e88a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1683277964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10932d9-a26a-484a-9726-f9bb8c641891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:53Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec392f-4c3e-4d57-a464-d113dab88652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ec392f-4c3e-4d57-a464-d113dab88652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71953798-1d48-4498-b8ed-6ebccc404ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71953798-1d48-4498-b8ed-6ebccc404ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10932d9-a26a-484a-9726-f9bb8c641891', 'volume_name': 'volume-e10932d9-a26a-484a-9726-f9bb8c641891', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a804d78-7d19-45d4-976e-e69af1375d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a804d78-7d19-45d4-976e-e69af1375d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d568f8-83e1-4277-b93f-53f15352930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Volume e10932d9-a26a-484a-9726-f9bb8c641891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10932d9-a26a-484a-9726-f9bb8c641891', 'volume_size': 1} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1683277964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10932d9-a26a-484a-9726-f9bb8c641891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:53Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Creating volume e10932d9-a26a-484a-9726-f9bb8c641891 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:53 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:23:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:53 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 1073741824 Nov 05 08:23:53 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22e8e98c-883d-4b0a-bef9-23a23445e1d6 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-1420049271: creating Nov 05 08:23:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22e8e98c-883d-4b0a-bef9-23a23445e1d6 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-1420049271: created successfully Nov 05 08:23:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22e8e98c-883d-4b0a-bef9-23a23445e1d6 tempest-GroupSnapshotsTest-1643865215 None] Create group completed successfully. Nov 05 08:23:54 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 1073741824" returned: 0 in 0.853s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:54 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 Nov 05 08:23:54 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:54 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d568f8-83e1-4277-b93f-53f15352930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10932d9-a26a-484a-9726-f9bb8c641891', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815a69b4-9a61-4e69-aad1-de3d9358241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Volume volume-e10932d9-a26a-484a-9726-f9bb8c641891 (e10932d9-a26a-484a-9726-f9bb8c641891): created successfully Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815a69b4-9a61-4e69-aad1-de3d9358241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (24410c3e-3aca-40bc-ab7c-9f5d657bc680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-04285dca-adc4-4a5b-8b9b-d362aca4dd76 tempest-AttachVolumeTestJSON-1684509141 None] Created volume successfully. Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (89f9ef69-0892-4b9e-878f-35177ce9a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869837f6-f4bb-4821-aa03-7dedd0acfac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869837f6-f4bb-4821-aa03-7dedd0acfac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251088280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=409edeec-0907-4d33-a449-eeb5158826f9,host='devstack@QuobyteHD#QuobyteHD',id=828390d5-da50-4677-96fc-ae0f38821a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:56Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a625ba2d-bf25-4be5-8e30-f0fbd810c317),volume_type_id=a625ba2d-bf25-4be5-8e30-f0fbd810c317)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659d684b-de36-443b-9cd8-a663b36fed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659d684b-de36-443b-9cd8-a663b36fed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06a78b5-7481-4ae6-b6e3-dcde21345419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06a78b5-7481-4ae6-b6e3-dcde21345419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828390d5-da50-4677-96fc-ae0f38821a78', 'volume_name': 'volume-828390d5-da50-4677-96fc-ae0f38821a78', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdda9db7-8eb0-4a64-b620-6df7f6413e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdda9db7-8eb0-4a64-b620-6df7f6413e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6bb656-139c-4897-91f3-aaacfa3959be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Volume 828390d5-da50-4677-96fc-ae0f38821a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828390d5-da50-4677-96fc-ae0f38821a78', 'volume_size': 1} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=409edeec-0907-4d33-a449-eeb5158826f9,created_at=2026-11-05T07:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251088280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=409edeec-0907-4d33-a449-eeb5158826f9,host='devstack@QuobyteHD#QuobyteHD',id=828390d5-da50-4677-96fc-ae0f38821a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:23:56Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a625ba2d-bf25-4be5-8e30-f0fbd810c317),volume_type_id=a625ba2d-bf25-4be5-8e30-f0fbd810c317)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Creating volume 828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:55 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:23:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:55 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 1073741824 Nov 05 08:23:55 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1992f9b2-ac9c-4852-974c-c9a4fdbaece2 req-c9587e18-a5e4-4eda-b530-1aef46504911 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:56 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 1073741824" returned: 0 in 0.941s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:56 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 Nov 05 08:23:56 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:23:57 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1992f9b2-ac9c-4852-974c-c9a4fdbaece2 req-c9587e18-a5e4-4eda-b530-1aef46504911 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.460s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6bb656-139c-4897-91f3-aaacfa3959be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828390d5-da50-4677-96fc-ae0f38821a78', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72771f70-1b10-45b6-beb6-5705664b3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1992f9b2-ac9c-4852-974c-c9a4fdbaece2 req-c9587e18-a5e4-4eda-b530-1aef46504911 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.073s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Volume volume-828390d5-da50-4677-96fc-ae0f38821a78 (828390d5-da50-4677-96fc-ae0f38821a78): created successfully Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72771f70-1b10-45b6-beb6-5705664b3390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (89f9ef69-0892-4b9e-878f-35177ce9a582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3088b614-bfbf-40d4-bf0c-e398a8c362a6 tempest-GroupSnapshotsTest-1643865215 None] Created volume successfully. Nov 05 08:23:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-1992f9b2-ac9c-4852-974c-c9a4fdbaece2 req-c9587e18-a5e4-4eda-b530-1aef46504911 tempest-AttachVolumeTestJSON-1684509141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-e10932d9-a26a-484a-9726-f9bb8c641891', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54889a37-431a-4f34-a9ea-37e4dd83ef3b', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:23:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1992f9b2-ac9c-4852-974c-c9a4fdbaece2 req-c9587e18-a5e4-4eda-b530-1aef46504911 tempest-AttachVolumeTestJSON-1684509141 None] attachment_update completed successfully. Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (92f6cd7b-ddb6-4804-bb60-f90b20fe4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf9add0-ad11-4859-b17d-6fa87f23ed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf9add0-ad11-4859-b17d-6fa87f23ed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760912648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=409edeec-0907-4d33-a449-eeb5158826f9,host='devstack@QuobyteHD#QuobyteHD',id=d8d89910-0251-4add-911d-fe1014007f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:00Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a625ba2d-bf25-4be5-8e30-f0fbd810c317),volume_type_id=a625ba2d-bf25-4be5-8e30-f0fbd810c317)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f6b338-b09a-42ce-9c9c-c0f082c1ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f6b338-b09a-42ce-9c9c-c0f082c1ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cb5061-b9c2-46bd-b3bf-38d4676d1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cb5061-b9c2-46bd-b3bf-38d4676d1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d89910-0251-4add-911d-fe1014007f6d', 'volume_name': 'volume-d8d89910-0251-4add-911d-fe1014007f6d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7567805-7f4d-4284-95ca-77557ac2f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7567805-7f4d-4284-95ca-77557ac2f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b147d2-17d8-4440-82f6-ec6d3edfff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:23:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Volume d8d89910-0251-4add-911d-fe1014007f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d89910-0251-4add-911d-fe1014007f6d', 'volume_size': 1} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=409edeec-0907-4d33-a449-eeb5158826f9,created_at=2026-11-05T07:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760912648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=409edeec-0907-4d33-a449-eeb5158826f9,host='devstack@QuobyteHD#QuobyteHD',id=d8d89910-0251-4add-911d-fe1014007f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:00Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a625ba2d-bf25-4be5-8e30-f0fbd810c317),volume_type_id=a625ba2d-bf25-4be5-8e30-f0fbd810c317)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Creating volume d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:23:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:23:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:23:59 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d 1073741824 Nov 05 08:23:59 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:00 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d 1073741824" returned: 0 in 0.823s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:00 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d Nov 05 08:24:00 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:01 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d" returned: 0 in 0.589s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b147d2-17d8-4440-82f6-ec6d3edfff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d89910-0251-4add-911d-fe1014007f6d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeeb30d-a3d2-4091-9712-df4160ad2fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Volume volume-d8d89910-0251-4add-911d-fe1014007f6d (d8d89910-0251-4add-911d-fe1014007f6d): created successfully Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeeb30d-a3d2-4091-9712-df4160ad2fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (92f6cd7b-ddb6-4804-bb60-f90b20fe4c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e0119c04-6893-42e3-9380-de00a6b533af tempest-GroupSnapshotsTest-1643865215 None] Created volume successfully. Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Flow 'volume_create_manager' (636bbc97-68cd-4dcf-a359-cfd5ed685fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b613c3-e159-419d-87d3-fdd624846ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b613c3-e159-419d-87d3-fdd624846ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-774954463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f8f991-e09c-4f70-94e7-8d239501d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d0c85015d42489f25e4364a5d51a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:02Z,use_quota=True,user_id='4d917776dc234b9e8275fef38f62cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3e64c-9554-4350-aa7d-2a92661c2a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3e64c-9554-4350-aa7d-2a92661c2a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b5367-f695-4389-9619-080a45ba3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b5367-f695-4389-9619-080a45ba3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f8f991-e09c-4f70-94e7-8d239501d879', 'volume_name': 'volume-34f8f991-e09c-4f70-94e7-8d239501d879', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa43cf1-404b-413f-a0ef-8094b9f943a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa43cf1-404b-413f-a0ef-8094b9f943a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3660ce31-01b7-4102-9bd4-f6a147d7366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Volume 34f8f991-e09c-4f70-94e7-8d239501d879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f8f991-e09c-4f70-94e7-8d239501d879', 'volume_size': 1} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-774954463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f8f991-e09c-4f70-94e7-8d239501d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58d0c85015d42489f25e4364a5d51a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:02Z,use_quota=True,user_id='4d917776dc234b9e8275fef38f62cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Creating volume 34f8f991-e09c-4f70-94e7-8d239501d879 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:24:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:01 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 1073741824 Nov 05 08:24:01 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:02 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 1073741824" returned: 0 in 0.999s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4cf7566d-8e5b-42e4-be97-9ed155d9792b tempest-GroupSnapshotsTest-1643865215 None] Update group completed successfully. Nov 05 08:24:02 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 Nov 05 08:24:02 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:03 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3660ce31-01b7-4102-9bd4-f6a147d7366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f8f991-e09c-4f70-94e7-8d239501d879', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce68d71-96bf-4e01-b9dc-4191e6a018b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Volume volume-34f8f991-e09c-4f70-94e7-8d239501d879 (34f8f991-e09c-4f70-94e7-8d239501d879): created successfully Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce68d71-96bf-4e01-b9dc-4191e6a018b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Flow 'volume_create_manager' (636bbc97-68cd-4dcf-a359-cfd5ed685fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d7beaad5-a0af-40fa-bf63-41ece4164201 tempest-ServerRescueNegativeTestJSON-2097793535 None] Created volume successfully. Nov 05 08:24:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2b725420-0b18-412a-84b0-93d749a6b06f tempest-GroupSnapshotsTest-1643865215 None] Update group completed successfully. Nov 05 08:24:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c6992113-bedb-4df0-bd5c-b2ddffb7df63 tempest-GroupSnapshotsTest-1643865215 None] Update group completed successfully. Nov 05 08:24:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-acbdb82a-f735-4fa7-b64e-9e94e68e4528 tempest-GroupSnapshotsTest-1643865215 None] Update group completed successfully. Nov 05 08:24:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] GroupSnapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: creating. Nov 05 08:24:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Group snapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:24:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Creating offline snapshot dad236d3-abf7-47c4-b75a-33a1d40b7cf8 of volume 828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:24:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[259631f0-abde-457b-98a3-733e312d8950]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:10 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 Nov 05 08:24:10 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:10 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78" returned: 0 in 0.892s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:10 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 1G Nov 05 08:24:10 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-103323b3-aaae-4115-9cf0-8567bd04a7cc req-8557fac4-6695-423b-893f-de240920f798 tempest-ServerActionsTestOtherA-1368412897 None] Terminate volume connection completed successfully. Nov 05 08:24:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-103323b3-aaae-4115-9cf0-8567bd04a7cc req-8557fac4-6695-423b-893f-de240920f798 tempest-ServerActionsTestOtherA-1368412897 None] Deleting attachment c5aba960-adba-428d-99eb-9ec3fcecc1f2. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:24:12 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 1G" returned: 0 in 1.150s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828390d5-da50-4677-96fc-ae0f38821a78 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:12 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828390d5-da50-4677-96fc-ae0f38821a78 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 Nov 05 08:24:12 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:12 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828390d5-da50-4677-96fc-ae0f38821a78 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:12 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 Nov 05 08:24:12 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:13 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8" returned: 0 in 0.741s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:13 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info Nov 05 08:24:13 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:14 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info" returned: 0 in 0.932s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:14 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info Nov 05 08:24:14 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:15 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.info" returned: 0 in 0.767s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.340s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=82,cinder:UPDATE=63,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Creating offline snapshot e71e9622-3b62-4851-b648-cd45fac6ee00 of volume d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cbbe98-3112-4c43-a362-dd906dfb49e5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:15 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d Nov 05 08:24:15 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:15 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d" returned: 0 in 0.599s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:15 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 1G Nov 05 08:24:15 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:16 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 1G" returned: 0 in 0.873s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d89910-0251-4add-911d-fe1014007f6d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:16 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d89910-0251-4add-911d-fe1014007f6d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 Nov 05 08:24:16 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:17 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d89910-0251-4add-911d-fe1014007f6d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:17 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:17 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 Nov 05 08:24:17 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:17 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:17 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=82,cinder:UPDATE=53,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:24:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:17 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info Nov 05 08:24:17 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Acquiring lock "cinder-34f8f991-e09c-4f70-94e7-8d239501d879-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:18 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:18 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:24:18 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:18 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "cinder-34f8f991-e09c-4f70-94e7-8d239501d879-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:18 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info Nov 05 08:24:18 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Acquiring lock "cinder-quobyte-34f8f991-e09c-4f70-94e7-8d239501d879" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "cinder-quobyte-34f8f991-e09c-4f70-94e7-8d239501d879" acquired by "delete_volume" :: waited 0.046s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d00b95-2d43-4d65-a48c-1198a471f056]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:18 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 Nov 05 08:24:18 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:18 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.701s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 8 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:24:18 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.info" returned: 0 in 0.660s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.749s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:19 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-449865a2-aec7-40aa-a286-021735ee1a14 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: created successfully Nov 05 08:24:19 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879 Nov 05 08:24:19 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:19 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34f8f991-e09c-4f70-94e7-8d239501d879" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "cinder-quobyte-34f8f991-e09c-4f70-94e7-8d239501d879" released by "delete_volume" :: held 0.975s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Created reservations ['7fdd89b5-24a6-493a-a282-eba0417b287b', '4b7744b6-ad15-498d-8145-8667a6b0718d', '5dbcc071-bc29-48d3-96ed-be07e1abf711', 'df286400-8686-4d3d-bb90-743ab8e4c203'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:19 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:24:19 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:20 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Deleted volume successfully. Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-521ccbd6-de4d-44ea-948c-59ce1e154986 tempest-ServerRescueNegativeTestJSON-2097793535 None] Lock "cinder-34f8f991-e09c-4f70-94e7-8d239501d879-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: deleting Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-dad236d3-abf7-47c4-b75a-33a1d40b7cf8" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-dad236d3-abf7-47c4-b75a-33a1d40b7cf8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Deleting offline snapshot dad236d3-abf7-47c4-b75a-33a1d40b7cf8 of volume 828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] snapshot_file for this snap is: volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2172b4-060a-4e6e-8756-ab842fd2ee51]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:20 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 Nov 05 08:24:20 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:21 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8" returned: 0 in 0.843s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828390d5-da50-4677-96fc-ae0f38821a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:24:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab169463-9af0-4750-91a4-cc184bd37c22]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:21 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 Nov 05 08:24:21 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:22 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78" returned: 0 in 1.062s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:22 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 Nov 05 08:24:22 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:23 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8" returned: 0 in 0.845s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:23 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8 Nov 05 08:24:23 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:23 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78.dad236d3-abf7-47c4-b75a-33a1d40b7cf8" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-dad236d3-abf7-47c4-b75a-33a1d40b7cf8" released by "_delete_snapshot" :: held 3.384s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" released by "delete_snapshot" :: held 3.421s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-e71e9622-3b62-4851-b648-cd45fac6ee00" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-e71e9622-3b62-4851-b648-cd45fac6ee00" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Deleting offline snapshot e71e9622-3b62-4851-b648-cd45fac6ee00 of volume d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] snapshot_file for this snap is: volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f94fc-1d7a-4059-a147-75d66b52c4e5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:24 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 Nov 05 08:24:24 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:24 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00" returned: 0 in 0.823s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d89910-0251-4add-911d-fe1014007f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e02664-570a-474a-a11f-c3c89172d477]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:24 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d Nov 05 08:24:24 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Flow 'volume_create_manager' (e2909451-9d40-4d0d-b785-4a059deb515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4179d6d8-91b5-4a16-9c58-70574d70d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4179d6d8-91b5-4a16-9c58-70574d70d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-705280180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c900ce0-8dba-4181-bcfc-78e90c56c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df5ee79cf534195a7ff6f7ab7644b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:25Z,use_quota=True,user_id='a69a2ff0de904f5f9d932fb114c67e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5754b21-a78d-40c6-87bc-31312c9d18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5754b21-a78d-40c6-87bc-31312c9d18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befc6b8d-da9c-410b-af7a-af68ab315f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:24:25 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d" returned: 0 in 0.502s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:25 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 Nov 05 08:24:25 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befc6b8d-da9c-410b-af7a-af68ab315f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c900ce0-8dba-4181-bcfc-78e90c56c661', 'volume_name': 'volume-4c900ce0-8dba-4181-bcfc-78e90c56c661', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc5aa63-5a2c-4017-bee2-8f6164d631c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc5aa63-5a2c-4017-bee2-8f6164d631c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec87fd67-a06d-4c73-ab54-45923c1ad89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Volume 4c900ce0-8dba-4181-bcfc-78e90c56c661: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c900ce0-8dba-4181-bcfc-78e90c56c661', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:24:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Trying to clone 4c900ce0-8dba-4181-bcfc-78e90c56c661 from image 9dbb82da-9633-4e04-9ee8-18373a09d135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:24:25 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00" returned: 0 in 0.724s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:26 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00 Nov 05 08:24:26 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:24:26 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[643cc27e-a9f0-4692-8333-d288fd4f01cb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:26 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d.e71e9622-3b62-4851-b648-cd45fac6ee00" returned: 0 in 0.641s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-e71e9622-3b62-4851-b648-cd45fac6ee00" released by "_delete_snapshot" :: held 2.848s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" released by "delete_snapshot" :: held 2.906s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:26 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD Nov 05 08:24:26 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:26 devstack cinder-volume[87092]: WARNING cinder.quota [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1400731311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1400731311, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:26 devstack cinder-volume[87092]: WARNING cinder.quota [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1400731311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1400731311, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['49b88771-975a-4f2c-b1e9-7cb210cc330c', 'a8725d4d-44fc-4bf5-a10c-788960504e8e', '4c0e1e4d-c591-4cac-9c4a-2f98b4e99b4a', '9fd5fa4f-d531-4ebb-972e-b162a0b35dc7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:27 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 is fetched for user a69a2ff0de904f5f9d932fb114c67e4c. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['c73a0551-a52a-4e9a-b2b9-4e6661e2ef84', 'f68c2162-f5ee-417c-8d71-4493a6abef88', 'dee88d86-e8ec-40e9-869c-7a90502ab76f', '21398b60-a721-47e6-b420-e28882d14b0b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac49639-1c9a-4378-b0c2-4c6cba750dc2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cc66f24d-e8bd-4d15-8fa3-e6bd01b77dc3 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 8d7705eb-5d55-403a-9a88-de91a5fc377a: deleted successfully Nov 05 08:24:27 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD Nov 05 08:24:27 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:27 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-705280180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c900ce0-8dba-4181-bcfc-78e90c56c661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8df5ee79cf534195a7ff6f7ab7644b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:25Z,use_quota=True,user_id='a69a2ff0de904f5f9d932fb114c67e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Creating volume 4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:27 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1073741824 Nov 05 08:24:27 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[57870c5b-fb88-446d-81f9-5cd404a41d91]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 Nov 05 08:24:28 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1073741824" returned: 0 in 0.645s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 Nov 05 08:24:28 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78 Nov 05 08:24:28 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Attempting download of 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 4c900ce0-8dba-4181-bcfc-78e90c56c661. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:24:28 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-828390d5-da50-4677-96fc-ae0f38821a78" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[babba2c4-c53f-4e58-aad3-7b7a36f8d3a5]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-828390d5-da50-4677-96fc-ae0f38821a78" released by "delete_volume" :: held 0.877s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[29547131-53d9-4036-b037-7198c0603df1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:28 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j Nov 05 08:24:28 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:28 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d Nov 05 08:24:28 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:29 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:29 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j Nov 05 08:24:29 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:29 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:29 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d Nov 05 08:24:29 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:29 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j" returned: 1 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_8bpm863j' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdabaf8-d491-4e99-b3c5-dbd7ce49c5c6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:29 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8d89910-0251-4add-911d-fe1014007f6d" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d8d89910-0251-4add-911d-fe1014007f6d" released by "delete_volume" :: held 0.769s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:29 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD Nov 05 08:24:29 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['b9602b49-d59f-4c85-aa2d-36ea48062dbd'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:29 devstack cinder-volume[87092]: WARNING cinder.quota [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1400731311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1400731311, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['47905d78-a973-4739-9bba-d8638d0aa6a2', '6f1180e9-309d-4f4a-bb6f-13bcfc9fdf47', '8f0fd0e7-3705-4ced-9bb1-bf3b53ba9fc9', '5e2f80ec-c31f-4074-a9d3-523823e3a1fc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['76fa42b9-f24c-40d2-b05d-00530c50da3a', '10610db7-2937-420d-affe-1408a218ed41', 'f0b86a5d-f281-4841-beb9-5c45a0e93ee7', '84e65ecd-e3d6-4bc4-9d66-50392e04eb78'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:29 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] 9dbb82da-9633-4e04-9ee8-18373a09d135 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:29 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 Nov 05 08:24:29 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:30 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:24:30 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:30 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fea79144-531d-4f78-b6c8-f3f7224eb50a tempest-GroupSnapshotsTest-1643865215 None] Delete group completed successfully. Nov 05 08:24:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-79d44118-e3d9-47f5-808f-ca815f6de771 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-2093511202: creating Nov 05 08:24:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-79d44118-e3d9-47f5-808f-ca815f6de771 tempest-GroupSnapshotsTest-1643865215 None] Group tempest-GroupSnapshotsTest-Group-2093511202: created successfully Nov 05 08:24:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-79d44118-e3d9-47f5-808f-ca815f6de771 tempest-GroupSnapshotsTest-1643865215 None] Create group completed successfully. Nov 05 08:24:32 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661" returned: 0 in 2.224s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_axb41c5cdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:24:32 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Converted 112.00 MB image at 50.27 MB/s Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:32 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1G Nov 05 08:24:32 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:32 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 1G" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Downloaded image 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 4c900ce0-8dba-4181-bcfc-78e90c56c661 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 for user a69a2ff0de904f5f9d932fb114c67e4c is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Marking volume 4c900ce0-8dba-4181-bcfc-78e90c56c661 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Copying metadata from image 9dbb82da-9633-4e04-9ee8-18373a09d135 to 4c900ce0-8dba-4181-bcfc-78e90c56c661. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Creating volume glance metadata for volume 4c900ce0-8dba-4181-bcfc-78e90c56c661 backed by image 9dbb82da-9633-4e04-9ee8-18373a09d135 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (3093921b-5ab2-4604-8611-1ce0576f3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914552a4-fed6-42db-b3cb-27d82e3fbcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914552a4-fed6-42db-b3cb-27d82e3fbcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1385155324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=257b1969-092e-4abc-8843-3238fe3809ac,host='devstack@QuobyteHD#QuobyteHD',id=d465b9cc-9547-4970-b917-9500acca861e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:33Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67347793-2755-455b-9939-e6fd04885946),volume_type_id=67347793-2755-455b-9939-e6fd04885946)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b2049-27f0-41f3-aa63-8a9ea58ecd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1b2049-27f0-41f3-aa63-8a9ea58ecd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827da57-1fdd-4986-8e11-ac569dc37bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827da57-1fdd-4986-8e11-ac569dc37bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd465b9cc-9547-4970-b917-9500acca861e', 'volume_name': 'volume-d465b9cc-9547-4970-b917-9500acca861e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f441469-f187-4aad-bd5a-bcc8fd2243de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f441469-f187-4aad-bd5a-bcc8fd2243de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9241b03b-3e1e-46e6-9de8-9edaf6287755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Volume d465b9cc-9547-4970-b917-9500acca861e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d465b9cc-9547-4970-b917-9500acca861e', 'volume_size': 1} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=257b1969-092e-4abc-8843-3238fe3809ac,created_at=2026-11-05T07:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1385155324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=257b1969-092e-4abc-8843-3238fe3809ac,host='devstack@QuobyteHD#QuobyteHD',id=d465b9cc-9547-4970-b917-9500acca861e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c663b4e6c54f450ab608356b85c566d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:24:33Z,use_quota=True,user_id='9273c5fda41a4d5182f5099c25f29c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67347793-2755-455b-9939-e6fd04885946),volume_type_id=67347793-2755-455b-9939-e6fd04885946)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Creating volume d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:24:32 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:32 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e 1073741824 Nov 05 08:24:32 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec87fd67-a06d-4c73-ab54-45923c1ad89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c900ce0-8dba-4181-bcfc-78e90c56c661', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607bc187-7acf-4995-94c3-6bca941e6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Volume volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 (4c900ce0-8dba-4181-bcfc-78e90c56c661): created successfully Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607bc187-7acf-4995-94c3-6bca941e6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Flow 'volume_create_manager' (e2909451-9d40-4d0d-b785-4a059deb515c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-972704f9-6794-41b1-96f4-cba61adb6934 tempest-ServerActionsTestOtherA-1368412897 None] Created volume successfully. Nov 05 08:24:33 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e 1073741824" returned: 0 in 0.635s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:33 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e Nov 05 08:24:33 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:33 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9241b03b-3e1e-46e6-9de8-9edaf6287755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d465b9cc-9547-4970-b917-9500acca861e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1153da2-45a8-4d94-9431-e77b0af08843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:24:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Volume volume-d465b9cc-9547-4970-b917-9500acca861e (d465b9cc-9547-4970-b917-9500acca861e): created successfully Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1153da2-45a8-4d94-9431-e77b0af08843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:24:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Flow 'volume_create_manager' (3093921b-5ab2-4604-8611-1ce0576f3628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:24:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7e1d612b-58c7-46f2-a554-f90ca42ba332 tempest-GroupSnapshotsTest-1643865215 None] Created volume successfully. Nov 05 08:24:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] GroupSnapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: creating. Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Group snapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Creating offline snapshot 97e409b4-fdde-4c99-8823-f2feb91d0b49 of volume d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3314f-6ee7-43d1-b827-47b5f6372cd0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:35 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e Nov 05 08:24:35 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:36 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:36 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 1G Nov 05 08:24:36 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:36 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 1G" returned: 0 in 0.591s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d465b9cc-9547-4970-b917-9500acca861e -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e2406f04-38b4-4e3a-bc61-5deccd6a5051 req-964036a8-d203-40be-9c94-7f49326d5fe3 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:36 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d465b9cc-9547-4970-b917-9500acca861e -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 Nov 05 08:24:36 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:36 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d465b9cc-9547-4970-b917-9500acca861e -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 Nov 05 08:24:37 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info Nov 05 08:24:37 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:37 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info Nov 05 08:24:37 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:37 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.info" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e2406f04-38b4-4e3a-bc61-5deccd6a5051 req-964036a8-d203-40be-9c94-7f49326d5fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.336s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e2406f04-38b4-4e3a-bc61-5deccd6a5051 req-964036a8-d203-40be-9c94-7f49326d5fe3 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-e2406f04-38b4-4e3a-bc61-5deccd6a5051 req-964036a8-d203-40be-9c94-7f49326d5fe3 tempest-ServerActionsTestOtherA-1368412897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-4c900ce0-8dba-4181-bcfc-78e90c56c661', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6448be74-c4cb-429e-a2c5-81bcb5a45761', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:24:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9bf543b0-a00e-4952-9cd8-e711ddf77548 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: created successfully Nov 05 08:24:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-e2406f04-38b4-4e3a-bc61-5deccd6a5051 req-964036a8-d203-40be-9c94-7f49326d5fe3 tempest-ServerActionsTestOtherA-1368412897 None] attachment_update completed successfully. Nov 05 08:24:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: deleting Nov 05 08:24:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:24:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-97e409b4-fdde-4c99-8823-f2feb91d0b49" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-97e409b4-fdde-4c99-8823-f2feb91d0b49" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Deleting offline snapshot 97e409b4-fdde-4c99-8823-f2feb91d0b49 of volume d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] snapshot_file for this snap is: volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ab42b-b8bf-4143-bcf3-ddd5cb5f50a0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:39 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 Nov 05 08:24:39 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:39 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49" returned: 0 in 0.683s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d465b9cc-9547-4970-b917-9500acca861e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec8d76-80c1-4fc9-8f61-acd231c84d00]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:39 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e Nov 05 08:24:40 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:40 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e" returned: 0 in 0.600s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:40 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 Nov 05 08:24:40 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:40 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49" returned: 0 in 0.475s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:40 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49 Nov 05 08:24:40 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:41 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e.97e409b4-fdde-4c99-8823-f2feb91d0b49" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-97e409b4-fdde-4c99-8823-f2feb91d0b49" released by "_delete_snapshot" :: held 2.240s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" released by "delete_snapshot" :: held 2.281s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1712128464 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1712128464, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1712128464 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1712128464, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['6b805252-ba32-492e-9671-2a285699ecde', '38d1798e-cc4c-4538-93da-f3d19e18f75d', '815c7665-515c-4ab4-965e-1060b4d847b1', '41a54fa4-8b9a-4807-a7a5-96a53903e0e3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-20e4d1d0-f8e7-4035-8862-9a4f2dfcfc72 tempest-GroupSnapshotsTest-1643865215 None] group_snapshot 37d603ff-7d02-4fe0-bc72-dfeaff22e379: deleted successfully Nov 05 08:24:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:24:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:24:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f30ad6-aaec-4209-b598-d5a29194ef39]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:24:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:43 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e Nov 05 08:24:43 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:43 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e" returned: 0 in 0.606s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:43 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e Nov 05 08:24:43 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:43 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d465b9cc-9547-4970-b917-9500acca861e" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Lock "cinder-quobyte-d465b9cc-9547-4970-b917-9500acca861e" released by "delete_volume" :: held 1.194s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['4599bbbd-09d9-4177-af15-b841a470fe34'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:44 devstack cinder-volume[87092]: WARNING cinder.quota [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1712128464 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1712128464, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Created reservations ['64bdc483-695b-4d04-8a44-85921961cedd', '07904ed1-c772-4f09-8573-464d72dad599', '61d2e123-bdf6-4aca-af7f-4beea373da09', '3ae5d883-5795-43e8-8e5e-8ce5fd6aa3ac'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:24:44 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:24:44 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:24:44 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:24:44 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:24:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-78e5ba58-0052-42b2-9256-3855d6316c84 tempest-GroupSnapshotsTest-1643865215 None] Delete group completed successfully. Nov 05 08:24:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-50738152-6bdd-4404-a41e-f7125f41daf5 req-8e7ecbe4-2a21-4f26-adf7-34da882379fc tempest-AttachVolumeTestJSON-1684509141 None] Terminate volume connection completed successfully. Nov 05 08:24:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-50738152-6bdd-4404-a41e-f7125f41daf5 req-8e7ecbe4-2a21-4f26-adf7-34da882379fc tempest-AttachVolumeTestJSON-1684509141 None] Deleting attachment 54889a37-431a-4f34-a9ea-37e4dd83ef3b. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:24:54 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=70,cinder:SELECT=68,cinder:INSERT=27 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:24:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-0c461ec9-a32c-4315-a233-13dd3b42d2f8 tempest-ServerActionsTestOtherA-1368412897 None] Terminate volume connection completed successfully. Nov 05 08:24:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-0c461ec9-a32c-4315-a233-13dd3b42d2f8 tempest-ServerActionsTestOtherA-1368412897 None] Deleting attachment 6448be74-c4cb-429e-a2c5-81bcb5a45761. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:24:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d2bb67e-7d75-42b1-bf3a-53d254c8f46e tempest-GroupsV320Test-573518464 None] Group tempest-GroupsV320Test-Group-1765283697: creating Nov 05 08:24:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d2bb67e-7d75-42b1-bf3a-53d254c8f46e tempest-GroupsV320Test-573518464 None] Group tempest-GroupsV320Test-Group-1765283697: created successfully Nov 05 08:24:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5d2bb67e-7d75-42b1-bf3a-53d254c8f46e tempest-GroupsV320Test-573518464 None] Create group completed successfully. Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-f4ab71d0-fd28-48a3-bbd2-0fc9150e1af4 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-f4ab71d0-fd28-48a3-bbd2-0fc9150e1af4 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-f4ab71d0-fd28-48a3-bbd2-0fc9150e1af4 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Created reservations ['aac8cdd7-685f-48f6-8f2d-28e1a5331911'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-f4ab71d0-fd28-48a3-bbd2-0fc9150e1af4 tempest-ServerActionsTestOtherA-1368412897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-4c900ce0-8dba-4181-bcfc-78e90c56c661', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09f62315-c63a-4f6a-9964-140ae26ca72a', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:00 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f70ff7c5-b5dd-4387-a6c8-567a0a168ba6 req-f4ab71d0-fd28-48a3-bbd2-0fc9150e1af4 tempest-ServerActionsTestOtherA-1368412897 None] attachment_update completed successfully. Nov 05 08:25:00 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:00 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:00 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2ba31f60-ebc5-44a5-b66d-b5caf029628c tempest-GroupsV320Test-573518464 None] Delete group completed successfully. Nov 05 08:25:10 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:25:10 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=93,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:18 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:18 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:19 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.829s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:19 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:19 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:25:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:25:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Flow 'volume_create_manager' (7a172a4b-a4ee-4031-b711-fec007d4eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116a154-be53-4107-96e6-0888817a20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116a154-be53-4107-96e6-0888817a20be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-461792125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2505af91-1240-4465-a701-491c32880c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f684213626545cda325238803a0abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:26Z,use_quota=True,user_id='332db4051b8d46e98d26ffecc6715244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801b0c83-fae3-4c39-a9ec-b053f692b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801b0c83-fae3-4c39-a9ec-b053f692b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6729afd-a781-45c2-bfa9-0b9bead4604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6729afd-a781-45c2-bfa9-0b9bead4604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2505af91-1240-4465-a701-491c32880c0c', 'volume_name': 'volume-2505af91-1240-4465-a701-491c32880c0c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1f3eaf-05aa-40ad-a43a-f5a9a206d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1f3eaf-05aa-40ad-a43a-f5a9a206d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742eb4c6-f48e-4db7-bd67-50f726383ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Volume 2505af91-1240-4465-a701-491c32880c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2505af91-1240-4465-a701-491c32880c0c', 'volume_size': 1} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-461792125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2505af91-1240-4465-a701-491c32880c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f684213626545cda325238803a0abaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:26Z,use_quota=True,user_id='332db4051b8d46e98d26ffecc6715244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Creating volume 2505af91-1240-4465-a701-491c32880c0c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:25:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:26 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c 1073741824 Nov 05 08:25:26 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:27 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c 1073741824" returned: 0 in 0.525s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:27 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c Nov 05 08:25:27 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:27 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742eb4c6-f48e-4db7-bd67-50f726383ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2505af91-1240-4465-a701-491c32880c0c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6236c71-2bc6-4768-b5aa-cf28cc404ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Volume volume-2505af91-1240-4465-a701-491c32880c0c (2505af91-1240-4465-a701-491c32880c0c): created successfully Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6236c71-2bc6-4768-b5aa-cf28cc404ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Flow 'volume_create_manager' (7a172a4b-a4ee-4031-b711-fec007d4eefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f7ea64ec-5872-4758-a6a3-7fa447b734ab tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Created volume successfully. Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Acquiring lock "cinder-2505af91-1240-4465-a701-491c32880c0c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "cinder-2505af91-1240-4465-a701-491c32880c0c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Acquiring lock "cinder-quobyte-2505af91-1240-4465-a701-491c32880c0c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "cinder-quobyte-2505af91-1240-4465-a701-491c32880c0c" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94540a9-c674-4865-bf5d-9dee66b6d91b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:30 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c Nov 05 08:25:30 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:30 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:30 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c Nov 05 08:25:30 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:30 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2505af91-1240-4465-a701-491c32880c0c" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "cinder-quobyte-2505af91-1240-4465-a701-491c32880c0c" released by "delete_volume" :: held 0.699s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Created reservations ['ac77f352-03c9-48ab-a00a-8548411b8eb8', 'a00f0f32-8f86-46a1-b38c-3ba0e262c1b3', '073d392b-f8c6-4d99-8ab9-6cb0541ff27e', '8067f2ee-3336-45be-ab0d-9a4120659b1f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:30 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:30 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:31 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Deleted volume successfully. Nov 05 08:25:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-16a36f91-9ac3-4dc8-abe4-1b54e2b6a489 tempest-VolumeQuotasNegativeTestJSON-1520731902 None] Lock "cinder-2505af91-1240-4465-a701-491c32880c0c-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-cde62fff-7087-4305-b122-47dfca6a766e req-d76b5e11-4474-4f44-82d3-b73a8a14caf6 tempest-ServerActionsTestOtherA-1368412897 None] Terminate volume connection completed successfully. Nov 05 08:25:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-cde62fff-7087-4305-b122-47dfca6a766e req-d76b5e11-4474-4f44-82d3-b73a8a14caf6 tempest-ServerActionsTestOtherA-1368412897 None] Deleting attachment 09f62315-c63a-4f6a-9964-140ae26ca72a. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "cinder-4c900ce0-8dba-4181-bcfc-78e90c56c661-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-4c900ce0-8dba-4181-bcfc-78e90c56c661-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "cinder-quobyte-4c900ce0-8dba-4181-bcfc-78e90c56c661" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-quobyte-4c900ce0-8dba-4181-bcfc-78e90c56c661" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[badaed7a-4189-4804-b1a3-6f7d742fc3f3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:40 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 Nov 05 08:25:40 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (10ddaa81-318a-4752-957a-2ebec6184f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d2094-63f1-4119-b278-ce8a2b8584d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d2094-63f1-4119-b278-ce8a2b8584d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1824506372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a114b4f-1219-4f83-a134-d69ed81ccd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:40Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573140d2-cdd8-4023-bd43-2d5fe2c9a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573140d2-cdd8-4023-bd43-2d5fe2c9a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35f4d74-c286-443c-8b34-786c7e7cb416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35f4d74-c286-443c-8b34-786c7e7cb416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a114b4f-1219-4f83-a134-d69ed81ccd72', 'volume_name': 'volume-4a114b4f-1219-4f83-a134-d69ed81ccd72', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a65b27-30fa-406a-bf8c-4b024ac2cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a65b27-30fa-406a-bf8c-4b024ac2cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c72e71-4d86-46de-8fc7-9860368b8b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Volume 4a114b4f-1219-4f83-a134-d69ed81ccd72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a114b4f-1219-4f83-a134-d69ed81ccd72', 'volume_size': 1} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1824506372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a114b4f-1219-4f83-a134-d69ed81ccd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:40Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Creating volume 4a114b4f-1219-4f83-a134-d69ed81ccd72 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:40 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:40 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661" returned: 0 in 0.582s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:40 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661 Nov 05 08:25:40 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 1073741824 Nov 05 08:25:41 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "cinder-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "cinder-quobyte-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-quobyte-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29c932-88fb-4b00-8e36-9f75eed946bf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:41 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c900ce0-8dba-4181-bcfc-78e90c56c661" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-quobyte-4c900ce0-8dba-4181-bcfc-78e90c56c661" released by "delete_volume" :: held 1.246s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:41 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc Nov 05 08:25:41 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.quota [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Created reservations ['393dcf01-5b72-4a2c-b089-70f55209055c', 'd32cd81f-11a7-40ed-8271-1d457f70e164', '9675ad54-7154-462b-ae0c-92aecae0132d', 'cf93a7d5-75b5-4b19-b7f6-05d0d8f9991a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:41 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:41 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:41 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" returned: 0 in 0.545s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:42 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc Nov 05 08:25:42 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:42 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 1073741824" returned: 0 in 1.118s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:42 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 Nov 05 08:25:42 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:42 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.617s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.manager [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Deleted volume successfully. Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-cde62fff-7087-4305-b122-47dfca6a766e req-57376b35-e039-42c9-947a-0c9b0eb2cd43 tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-4c900ce0-8dba-4181-bcfc-78e90c56c661-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:42 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" returned: 0 in 0.672s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-quobyte-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc" released by "delete_volume" :: held 1.315s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72" returned: 0 in 0.543s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c72e71-4d86-46de-8fc7-9860368b8b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a114b4f-1219-4f83-a134-d69ed81ccd72', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1c58ff-8101-40e5-a719-5a311df49ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Volume volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 (4a114b4f-1219-4f83-a134-d69ed81ccd72): created successfully Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1c58ff-8101-40e5-a719-5a311df49ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (10ddaa81-318a-4752-957a-2ebec6184f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3bf1b833-a48b-4174-84b0-1aaaf6138c21 tempest-AttachVolumeNegativeTest-88548250 None] Created volume successfully. Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Created reservations ['587efb52-142c-4ce2-b427-e1247bdf321e', 'b289fb5d-a9e3-458d-bdb5-ec0897c7f289', '3f9b50b2-01f5-426c-aa02-a28711dc39a0', 'b13615cc-0109-44e3-a11b-c8c9b6e65e39'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:42 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:42 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:43 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Deleted volume successfully. Nov 05 08:25:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2a3f6708-8cb3-4009-bd9b-a738e7b8e66a tempest-ServerActionsTestOtherA-1368412897 None] Lock "cinder-b69d5218-5a5c-471b-9114-2a4ed0fc4ebc-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e129663d-0fd3-488e-b8ae-92c2c63abfd7 req-43824a3f-c4b9-4d7d-99bd-c595c7b4245f tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e129663d-0fd3-488e-b8ae-92c2c63abfd7 req-43824a3f-c4b9-4d7d-99bd-c595c7b4245f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-e129663d-0fd3-488e-b8ae-92c2c63abfd7 req-43824a3f-c4b9-4d7d-99bd-c595c7b4245f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-e129663d-0fd3-488e-b8ae-92c2c63abfd7 req-43824a3f-c4b9-4d7d-99bd-c595c7b4245f tempest-AttachVolumeNegativeTest-88548250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-4a114b4f-1219-4f83-a134-d69ed81ccd72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8879e1d7-4ac9-4c2f-aa02-1284163d7fde', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:25:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-e129663d-0fd3-488e-b8ae-92c2c63abfd7 req-43824a3f-c4b9-4d7d-99bd-c595c7b4245f tempest-AttachVolumeNegativeTest-88548250 None] attachment_update completed successfully. Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Flow 'volume_create_manager' (5294c7a5-ade3-4f67-9466-3d752f8c6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3979d6a-1d0b-4eb3-a7c7-2bc221b1f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3979d6a-1d0b-4eb3-a7c7-2bc221b1f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-912165351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579abe7d-c641-4770-a781-bebd3a4cae69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b48aeacb71624aae8b788317eb385f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:46Z,use_quota=True,user_id='df428e35fd484ebba55dde6f983363c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e5351e-e222-40c9-89aa-60d562cbf932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e5351e-e222-40c9-89aa-60d562cbf932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c558871-7e53-47bb-9e93-56afebfd1b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c558871-7e53-47bb-9e93-56afebfd1b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579abe7d-c641-4770-a781-bebd3a4cae69', 'volume_name': 'volume-579abe7d-c641-4770-a781-bebd3a4cae69', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76c09d6-a967-4d7e-bbcc-e60a69e24c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76c09d6-a967-4d7e-bbcc-e60a69e24c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bba311b-ea0d-4aa0-91ad-18e84e501573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Volume 579abe7d-c641-4770-a781-bebd3a4cae69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579abe7d-c641-4770-a781-bebd3a4cae69', 'volume_size': 1} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-912165351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579abe7d-c641-4770-a781-bebd3a4cae69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b48aeacb71624aae8b788317eb385f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:25:46Z,use_quota=True,user_id='df428e35fd484ebba55dde6f983363c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Creating volume 579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:25:46 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:25:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:46 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 1073741824 Nov 05 08:25:46 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:47 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 1073741824" returned: 0 in 0.786s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:47 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 Nov 05 08:25:47 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:47 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bba311b-ea0d-4aa0-91ad-18e84e501573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579abe7d-c641-4770-a781-bebd3a4cae69', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068d752c-88ba-4689-a15f-08d5cd66d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:25:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Volume volume-579abe7d-c641-4770-a781-bebd3a4cae69 (579abe7d-c641-4770-a781-bebd3a4cae69): created successfully Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068d752c-88ba-4689-a15f-08d5cd66d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:25:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Flow 'volume_create_manager' (5294c7a5-ade3-4f67-9466-3d752f8c6e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:25:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e9159eb-8813-4f45-929e-a6f1cf8da923 tempest-SnapshotMetadataTestJSON-122100512 None] Created volume successfully. Nov 05 08:25:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Creating offline snapshot 8e9e280e-17fe-4149-8095-509375b74ac4 of volume 579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:25:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1383c123-fdd6-4c5c-a2fd-36e51d1acd39]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:48 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 Nov 05 08:25:48 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:49 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:49 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 1G Nov 05 08:25:49 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:49 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 1G" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579abe7d-c641-4770-a781-bebd3a4cae69 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:49 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579abe7d-c641-4770-a781-bebd3a4cae69 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 Nov 05 08:25:49 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:50 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579abe7d-c641-4770-a781-bebd3a4cae69 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4" returned: 0 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:50 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 is being set with open permissions: ugo+rw Nov 05 08:25:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:50 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 Nov 05 08:25:50 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:50 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:50 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info Nov 05 08:25:50 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:51 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info is being set with open permissions: ugo+rw Nov 05 08:25:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:51 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info Nov 05 08:25:51 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:51 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.info" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ca9dca4f-0877-428c-ae9c-8b39b198a062 tempest-SnapshotMetadataTestJSON-122100512 None] Create snapshot completed successfully Nov 05 08:25:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "cinder-8e9e280e-17fe-4149-8095-509375b74ac4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-8e9e280e-17fe-4149-8095-509375b74ac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "cinder-quobyte-8e9e280e-17fe-4149-8095-509375b74ac4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-8e9e280e-17fe-4149-8095-509375b74ac4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Deleting offline snapshot 8e9e280e-17fe-4149-8095-509375b74ac4 of volume 579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] snapshot_file for this snap is: volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6712b4-a055-44df-8d98-6be7e7540dfa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:53 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 Nov 05 08:25:53 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:53 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4" returned: 0 in 0.553s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-579abe7d-c641-4770-a781-bebd3a4cae69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b4e21-9f0f-4653-91e5-98caaa9482aa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:53 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 Nov 05 08:25:53 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:54 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:54 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 Nov 05 08:25:54 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:54 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:54 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4 Nov 05 08:25:54 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:54 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69.8e9e280e-17fe-4149-8095-509375b74ac4" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-8e9e280e-17fe-4149-8095-509375b74ac4" released by "_delete_snapshot" :: held 1.958s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" released by "delete_snapshot" :: held 1.994s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:55 devstack cinder-volume[87092]: WARNING cinder.quota [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:25:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Created reservations ['b34e1f33-74e7-41e3-a508-f5317d8f545d', '139bacbd-7aef-49b7-bd9f-83c91854018b', '8613d00f-4ff0-4bc2-b91c-aac9bdd285ad', '6034536a-776f-4b7b-81d7-a5282c01f24e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Delete snapshot completed successfully. Nov 05 08:25:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-19e3ea56-a2b0-450f-a95d-b20c5d323ec0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-8e9e280e-17fe-4149-8095-509375b74ac4-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "cinder-579abe7d-c641-4770-a781-bebd3a4cae69-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-579abe7d-c641-4770-a781-bebd3a4cae69-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91742b0-a50b-481b-ac38-b97815d8d536]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:25:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:56 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 Nov 05 08:25:56 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:57 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69" returned: 0 in 0.613s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:57 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69 Nov 05 08:25:57 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:57 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-579abe7d-c641-4770-a781-bebd3a4cae69" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-quobyte-579abe7d-c641-4770-a781-bebd3a4cae69" released by "delete_volume" :: held 1.145s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Created reservations ['c4e96498-ea4c-40a7-b0ae-c251ea0504d4', '923d6678-9d9e-4398-b39f-cdcfaf4f0f90', '1acc019b-4be1-4da1-b7ca-9bc2d55321c4', 'ff69e686-a12c-463d-9455-39ca2d117dc1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:25:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:25:58 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:25:58 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:25:58 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Nov 05 08:25:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.521s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:25:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:25:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Deleted volume successfully. Nov 05 08:25:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c196fc31-d868-4e4a-b378-2c38c7b49eb0 tempest-SnapshotMetadataTestJSON-122100512 None] Lock "cinder-579abe7d-c641-4770-a781-bebd3a4cae69-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (06253ce7-cf9c-41dd-bcd9-fc5c7df5265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc75d73-6ff9-43bb-a03b-e7b8b10d943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc75d73-6ff9-43bb-a03b-e7b8b10d943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-343335914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8344e9-d072-4694-88bc-54049f7542e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:03Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34543bf2-70aa-4748-a14b-b40bf02a3824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34543bf2-70aa-4748-a14b-b40bf02a3824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ee4e56-124d-4cc3-a88b-427c4a846819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ee4e56-124d-4cc3-a88b-427c4a846819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8344e9-d072-4694-88bc-54049f7542e4', 'volume_name': 'volume-0c8344e9-d072-4694-88bc-54049f7542e4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2220e8-28ba-48d1-8535-a9b631549e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2220e8-28ba-48d1-8535-a9b631549e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cfd907-e58c-4d99-9422-11413123af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Volume 0c8344e9-d072-4694-88bc-54049f7542e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8344e9-d072-4694-88bc-54049f7542e4', 'volume_size': 1} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-343335914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8344e9-d072-4694-88bc-54049f7542e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:03Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Creating volume 0c8344e9-d072-4694-88bc-54049f7542e4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:03 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 1073741824 Nov 05 08:26:03 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:04 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 1073741824" returned: 0 in 0.815s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:04 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 Nov 05 08:26:04 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:04 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cfd907-e58c-4d99-9422-11413123af0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8344e9-d072-4694-88bc-54049f7542e4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166b1ec-63a4-4a24-9bf9-816261482088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Volume volume-0c8344e9-d072-4694-88bc-54049f7542e4 (0c8344e9-d072-4694-88bc-54049f7542e4): created successfully Nov 05 08:26:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166b1ec-63a4-4a24-9bf9-816261482088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (06253ce7-cf9c-41dd-bcd9-fc5c7df5265c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2018ab35-21cd-4e21-b58b-34ad1673c3ee tempest-AttachVolumeTestJSON-1684509141 None] Created volume successfully. Nov 05 08:26:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-47268142-6ee9-470f-9247-729a24a1e929 req-313bf32e-7f35-4f62-b05e-ff7bedda3724 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-47268142-6ee9-470f-9247-729a24a1e929 req-313bf32e-7f35-4f62-b05e-ff7bedda3724 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-47268142-6ee9-470f-9247-729a24a1e929 req-313bf32e-7f35-4f62-b05e-ff7bedda3724 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-47268142-6ee9-470f-9247-729a24a1e929 req-313bf32e-7f35-4f62-b05e-ff7bedda3724 tempest-AttachVolumeTestJSON-1684509141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-0c8344e9-d072-4694-88bc-54049f7542e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dba6eeb-5467-4945-83c0-774d19858169', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:26:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-47268142-6ee9-470f-9247-729a24a1e929 req-313bf32e-7f35-4f62-b05e-ff7bedda3724 tempest-AttachVolumeTestJSON-1684509141 None] attachment_update completed successfully. Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (19814f07-80ed-424e-9844-fbf436d137ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25680f8-a2b8-47e3-8ac9-bb76e8a56687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25680f8-a2b8-47e3-8ac9-bb76e8a56687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355189007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:10Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45a876-fcea-416b-9abe-aebe212a5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45a876-fcea-416b-9abe-aebe212a5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd765eee-7e5d-4f95-a096-f976e89b4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd765eee-7e5d-4f95-a096-f976e89b4763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95', 'volume_name': 'volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f210f7e4-ece8-40da-b155-d8cb30ae36cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f210f7e4-ece8-40da-b155-d8cb30ae36cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426bb4b6-44da-4802-9c9b-9aeb2e30d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Volume 1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95', 'volume_size': 1} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1355189007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f425ee8535a4a3d91b4d6f0c3a7455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:10Z,use_quota=True,user_id='0d8782c8cd9a4b548e319c27a23fc1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Creating volume 1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:10 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 1073741824 Nov 05 08:26:10 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:11 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 1073741824" returned: 0 in 0.928s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:11 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 Nov 05 08:26:11 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (877a6328-ef84-437b-874f-ffd158de2d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:11 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34c7a40-392d-432f-9c78-ec9ae93555c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34c7a40-392d-432f-9c78-ec9ae93555c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1409880584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daa2dc3-a6c8-4aaa-a748-fecb12ba0342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da44a1ffba144109a5701daf954c690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:12Z,use_quota=True,user_id='737fa7b4e1244858a16d7b6b04a925f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a02cb4-c163-48fd-8492-5620e2f84fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a02cb4-c163-48fd-8492-5620e2f84fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4ef944-6c24-498c-8363-9507ba767b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4ef944-6c24-498c-8363-9507ba767b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1daa2dc3-a6c8-4aaa-a748-fecb12ba0342', 'volume_name': 'volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0874a203-facc-4780-84e1-badeaaf696d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0874a203-facc-4780-84e1-badeaaf696d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1306a9-c2b2-4d53-9225-2a56f4bc5963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342', 'volume_size': 1} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1409880584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daa2dc3-a6c8-4aaa-a748-fecb12ba0342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da44a1ffba144109a5701daf954c690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:12Z,use_quota=True,user_id='737fa7b4e1244858a16d7b6b04a925f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Creating volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:11 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426bb4b6-44da-4802-9c9b-9aeb2e30d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b02963-a2b3-4ea8-958f-3e636c521a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:12 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 1073741824 Nov 05 08:26:12 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Volume volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 (1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95): created successfully Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b02963-a2b3-4ea8-958f-3e636c521a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Flow 'volume_create_manager' (19814f07-80ed-424e-9844-fbf436d137ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d9720643-43c1-41a5-a307-c4b1c28d481e tempest-AttachVolumeTestJSON-1684509141 None] Created volume successfully. Nov 05 08:26:12 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 1073741824" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:12 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 Nov 05 08:26:12 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:12 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1306a9-c2b2-4d53-9225-2a56f4bc5963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4a958-26ea-490e-949c-5472469324e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Volume volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 (1daa2dc3-a6c8-4aaa-a748-fecb12ba0342): created successfully Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f4a958-26ea-490e-949c-5472469324e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (877a6328-ef84-437b-874f-ffd158de2d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-84efd7f7-6a40-407d-ba1c-71dc809bc1b8 tempest-VolumesDeleteCascade-517039318 None] Created volume successfully. Nov 05 08:26:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3fc69905-5923-4c72-a05a-8bbeea56433d req-b7be7559-b9d5-462b-915e-87c6995d6447 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3fc69905-5923-4c72-a05a-8bbeea56433d req-b7be7559-b9d5-462b-915e-87c6995d6447 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-3fc69905-5923-4c72-a05a-8bbeea56433d req-b7be7559-b9d5-462b-915e-87c6995d6447 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-3fc69905-5923-4c72-a05a-8bbeea56433d req-b7be7559-b9d5-462b-915e-87c6995d6447 tempest-AttachVolumeTestJSON-1684509141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab213b1d-1d4e-4278-b508-b299f94f688a', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:26:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-3fc69905-5923-4c72-a05a-8bbeea56433d req-b7be7559-b9d5-462b-915e-87c6995d6447 tempest-AttachVolumeTestJSON-1684509141 None] attachment_update completed successfully. Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Creating offline snapshot eae52426-c3b7-4acd-9666-ba9f5c88d581 of volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fff1ea-faae-4b5b-9cf6-689fa7ffbe6a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:14 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 Nov 05 08:26:14 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:14 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" returned: 0 in 0.479s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:14 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 1G Nov 05 08:26:14 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-43118646-dcdb-4645-9e9a-9091ab543fca req-515b8740-ed42-4756-8e7b-e3def7e26142 tempest-AttachVolumeTestJSON-1684509141 None] Terminate volume connection completed successfully. Nov 05 08:26:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-43118646-dcdb-4645-9e9a-9091ab543fca req-515b8740-ed42-4756-8e7b-e3def7e26142 tempest-AttachVolumeTestJSON-1684509141 None] Deleting attachment 6dba6eeb-5467-4945-83c0-774d19858169. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:26:15 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 1G" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:15 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:15 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:15 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 is being set with open permissions: ugo+rw Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:15 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:15 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:15 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:15 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info Nov 05 08:26:15 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:16 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info" returned: 0 in 0.338s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info is being set with open permissions: ugo+rw Nov 05 08:26:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:16 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info Nov 05 08:26:16 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-37f96e28-8d77-4419-b33c-25c099062536 req-7ca0e69e-1703-42ed-a30b-4ce05e348e47 tempest-AttachVolumeTestJSON-1684509141 None] Terminate volume connection completed successfully. Nov 05 08:26:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-37f96e28-8d77-4419-b33c-25c099062536 req-7ca0e69e-1703-42ed-a30b-4ce05e348e47 tempest-AttachVolumeTestJSON-1684509141 None] Deleting attachment ab213b1d-1d4e-4278-b508-b299f94f688a. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:26:16 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.info" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8ad91ebb-723e-41ec-a056-4f196b39b2d5 tempest-VolumesDeleteCascade-517039318 None] Create snapshot completed successfully Nov 05 08:26:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Creating offline snapshot 5571b7b0-5885-44a4-8b03-b0761af45ae1 of volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:26:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370d1f9-a53d-4d80-aa2f-87cb93e58afe]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:17 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:17 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:18 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:18 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:18 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.836s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:18 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 1G Nov 05 08:26:18 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:18 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.616s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:26:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:26:19 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 1G" returned: 0 in 0.934s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:19 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 Nov 05 08:26:19 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:19 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:19 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 is being set with open permissions: ugo+rw Nov 05 08:26:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:19 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 Nov 05 08:26:19 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:20 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b373899d-6fa5-44d0-aefa-d6567fc00323 tempest-VolumesDeleteCascade-517039318 None] Create snapshot completed successfully Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=72,cinder:SELECT=76,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=58,cinder:DELETE=9 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Performing cascade delete. {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-5571b7b0-5885-44a4-8b03-b0761af45ae1-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-5571b7b0-5885-44a4-8b03-b0761af45ae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-5571b7b0-5885-44a4-8b03-b0761af45ae1" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5571b7b0-5885-44a4-8b03-b0761af45ae1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Deleting offline snapshot 5571b7b0-5885-44a4-8b03-b0761af45ae1 of volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] snapshot_file for this snap is: volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b70cca-a943-4761-b288-60fbb40edc97]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:21 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 Nov 05 08:26:21 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:21 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1" returned: 0 in 0.535s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2621e22-f4f8-4d0b-ba3b-435150c7f63a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:21 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:21 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:22 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.957s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:22 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 Nov 05 08:26:22 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:23 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1" returned: 0 in 1.000s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:23 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1 Nov 05 08:26:23 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:24 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.5571b7b0-5885-44a4-8b03-b0761af45ae1" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5571b7b0-5885-44a4-8b03-b0761af45ae1" released by "_delete_snapshot" :: held 3.086s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" released by "delete_snapshot" :: held 3.125s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Created reservations ['c806dc0d-e1f6-4c72-84b9-0a43306260f4', 'fb6f94cd-cb90-4c74-91ee-603e55550da1', 'ae036d56-2fd2-4a8c-9625-ad8f58cc33d2', 'b730a80a-c819-4da8-ae20-421aa8760f25'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Delete snapshot completed successfully. Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-5571b7b0-5885-44a4-8b03-b0761af45ae1-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-eae52426-c3b7-4acd-9666-ba9f5c88d581-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-eae52426-c3b7-4acd-9666-ba9f5c88d581-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-eae52426-c3b7-4acd-9666-ba9f5c88d581" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-eae52426-c3b7-4acd-9666-ba9f5c88d581" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Deleting offline snapshot eae52426-c3b7-4acd-9666-ba9f5c88d581 of volume 1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] snapshot_file for this snap is: volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd26115-4a30-4dc7-b516-221baa05dc5b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:24 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:24 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:25 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.642s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a34022-740b-4838-9ce1-cba199d2fc3b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:25 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 Nov 05 08:26:25 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-quobyte-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40262e-41ac-4c99-af68-2a3fcbb275f5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:25 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" returned: 0 in 0.583s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:26 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:26 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:26 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 Nov 05 08:26:26 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:26 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" returned: 0 in 0.663s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:26 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95 Nov 05 08:26:26 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:26 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.810s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:26 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581 Nov 05 08:26:26 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:27 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95" released by "delete_volume" :: held 1.211s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Created reservations ['49d50ead-84d6-4fcd-8479-5d9186c613be', '54e848a7-9e46-4cf1-803e-543fb570f120', '839b35f8-ef7d-4fa0-9f34-593b356e6183', '52523718-e709-4012-9222-7f38749ab845'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:27 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342.eae52426-c3b7-4acd-9666-ba9f5c88d581" returned: 0 in 0.595s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:27 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:27 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-eae52426-c3b7-4acd-9666-ba9f5c88d581" released by "_delete_snapshot" :: held 2.943s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" released by "delete_snapshot" :: held 3.007s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Created reservations ['20e5e829-fee6-443b-9e3f-28ed6072ba2e', '6ea6b094-e158-4c53-beca-5aad25e5cbad', '6f901a96-5c46-46a6-b334-69593377fac4', '7f35b152-6e84-4d72-b75f-e2ca095f32ab'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Delete snapshot completed successfully. Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-eae52426-c3b7-4acd-9666-ba9f5c88d581-delete_snapshot" released by "delete_snapshot" :: held 3.347s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Snapshots deleted, issuing volume delete {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaebf48-3434-4e53-87ef-d7d459f1fedc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:27 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Deleted volume successfully. Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-67215e69-b16d-4d6e-8954-60fbfe6d2f32 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-1d0e5f9e-83c1-4e07-9ef0-cee3611f1e95-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-0c8344e9-d072-4694-88bc-54049f7542e4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-0c8344e9-d072-4694-88bc-54049f7542e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-quobyte-0c8344e9-d072-4694-88bc-54049f7542e4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-0c8344e9-d072-4694-88bc-54049f7542e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:28 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 Nov 05 08:26:28 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c4d68-c6ce-4552-baec-bef9e083d75d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:28 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 Nov 05 08:26:28 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a8735e38-d63f-463c-9417-db57267078aa req-30b620e7-b1f8-4773-98e2-9a6145344b2c tempest-AttachVolumeNegativeTest-88548250 None] Terminate volume connection completed successfully. Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a8735e38-d63f-463c-9417-db57267078aa req-30b620e7-b1f8-4773-98e2-9a6145344b2c tempest-AttachVolumeNegativeTest-88548250 None] Deleting attachment 8879e1d7-4ac9-4c2f-aa02-1284163d7fde. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:26:28 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" returned: 0 in 0.868s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:28 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342 Nov 05 08:26:28 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:28 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4" returned: 0 in 0.682s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:28 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4 Nov 05 08:26:28 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:29 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342" released by "delete_volume" :: held 1.341s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Created reservations ['15ef3186-b0e0-489d-afb3-c76390b90942', '1afbaa18-ae50-449f-bc99-785bda097c88', '8e3f259d-64c5-4516-8f2d-edd07344abff', '8c9219f0-a02b-4f76-84e8-4ca0372c2346'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:29 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0c8344e9-d072-4694-88bc-54049f7542e4" returned: 0 in 0.339s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-0c8344e9-d072-4694-88bc-54049f7542e4" released by "delete_volume" :: held 1.094s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:29 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:29 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Created reservations ['ba2545f6-6641-460e-80db-ef9fd099496c', '7e939840-9a92-4aec-8997-c1a8a5a78419', 'ec506c50-68fa-4162-b579-4c7c927d1d5c', 'e81a37a5-e07c-4e21-a7ca-0d9258812594'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:29 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:29 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:29 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.463s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Deleted volume successfully. Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9de76ca1-3b10-4258-93cf-f31bcd18fb92 tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-1daa2dc3-a6c8-4aaa-a748-fecb12ba0342-delete_volume" released by "delete_volume" :: held 8.933s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:29 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Deleted volume successfully. Nov 05 08:26:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4cfe7f4d-ac3e-4f6c-8257-5b97d9443fcd tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-0c8344e9-d072-4694-88bc-54049f7542e4-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-e10932d9-a26a-484a-9726-f9bb8c641891-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-e10932d9-a26a-484a-9726-f9bb8c641891-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "cinder-quobyte-e10932d9-a26a-484a-9726-f9bb8c641891" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-e10932d9-a26a-484a-9726-f9bb8c641891" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4036499-c986-43cc-8abd-640abba672fa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:31 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 Nov 05 08:26:31 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:31 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (eeca90dc-5ed3-4d74-b458-d4dc2cbedfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2311bdf8-0241-49fd-ae50-1e7a320af0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2311bdf8-0241-49fd-ae50-1e7a320af0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302545692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcfddb8-5733-4311-9679-e402a4ad6ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da44a1ffba144109a5701daf954c690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:32Z,use_quota=True,user_id='737fa7b4e1244858a16d7b6b04a925f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a74ebfb-495a-43a3-8912-1f4d324bcb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a74ebfb-495a-43a3-8912-1f4d324bcb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f7bee-02d9-43f8-963d-ab9633463f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24f7bee-02d9-43f8-963d-ab9633463f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcfddb8-5733-4311-9679-e402a4ad6ddd', 'volume_name': 'volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9b6f1-2399-48de-8da0-24428328b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f9b6f1-2399-48de-8da0-24428328b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da74cb0-0874-4a31-8447-804a0930b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:31 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Volume ebcfddb8-5733-4311-9679-e402a4ad6ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd', 'volume_size': 1} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1302545692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcfddb8-5733-4311-9679-e402a4ad6ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da44a1ffba144109a5701daf954c690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:32Z,use_quota=True,user_id='737fa7b4e1244858a16d7b6b04a925f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Creating volume ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:31 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891" returned: 0 in 0.874s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:31 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd 1073741824 Nov 05 08:26:31 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:31 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891 Nov 05 08:26:31 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:32 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e10932d9-a26a-484a-9726-f9bb8c641891" returned: 0 in 0.536s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-quobyte-e10932d9-a26a-484a-9726-f9bb8c641891" released by "delete_volume" :: held 1.505s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:32 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd 1073741824" returned: 0 in 0.635s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Created reservations ['c0a9467e-9221-4df5-bad5-b84244de9c25', 'd76a010c-bcc6-42c5-9b98-afe2a559a163', '9567bf19-875c-41d9-9e4c-3ea8410c8df8', '55db4b15-61c4-440c-b70d-0b74fc0ad8dd'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:32 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:32 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:32 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:32 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:32 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.435s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da74cb0-0874-4a31-8447-804a0930b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028c8203-d68f-4c46-ba9e-ae0635a5371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:32 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Volume volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd (ebcfddb8-5733-4311-9679-e402a4ad6ddd): created successfully Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028c8203-d68f-4c46-ba9e-ae0635a5371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (eeca90dc-5ed3-4d74-b458-d4dc2cbedfd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3c660935-3cfc-4693-979a-c7b4b534da57 tempest-VolumesDeleteCascade-517039318 None] Created volume successfully. Nov 05 08:26:32 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Deleted volume successfully. Nov 05 08:26:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2b6f302-b27c-4004-8148-a99c09b78e15 tempest-AttachVolumeTestJSON-1684509141 None] Lock "cinder-e10932d9-a26a-484a-9726-f9bb8c641891-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Creating offline snapshot 46218ec5-d50a-409c-bec1-8b09914d7c0b of volume ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:26:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[172a810c-c8ce-4444-8210-63552557156b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:34 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:34 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:34 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:34 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b 1G Nov 05 08:26:34 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:35 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b 1G" returned: 0 in 0.625s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:35 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:35 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:35 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:35 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b is being set with open permissions: ugo+rw Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:35 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:35 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:35 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:35 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info Nov 05 08:26:35 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:36 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:36 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info is being set with open permissions: ugo+rw Nov 05 08:26:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:36 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info Nov 05 08:26:36 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:36 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.info" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f32d7077-68b4-463c-b6f1-dd97fd7c0c00 tempest-VolumesDeleteCascade-517039318 None] Create snapshot completed successfully Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (834928e3-949e-41f8-9c1a-3f2f1fbf9121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff70d1-8a2b-4859-8f57-0c581edc3222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ff70d1-8a2b-4859-8f57-0c581edc3222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1666020708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c6f91-0c53-410b-a927-fada1c7cb1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3da44a1ffba144109a5701daf954c690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46218ec5-d50a-409c-bec1-8b09914d7c0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:38Z,use_quota=True,user_id='737fa7b4e1244858a16d7b6b04a925f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3b4234-f940-4deb-b1c9-1f84ce748457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3b4234-f940-4deb-b1c9-1f84ce748457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8170149f-eb56-4bce-80c9-592df9565a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8170149f-eb56-4bce-80c9-592df9565a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e8c6f91-0c53-410b-a927-fada1c7cb1d4', 'volume_name': 'volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4', 'volume_size': 1, 'snapshot_id': '46218ec5-d50a-409c-bec1-8b09914d7c0b'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13016b8-a24b-47af-9909-8008209dbb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13016b8-a24b-47af-9909-8008209dbb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7b256-c832-4174-9b14-a3b298480888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Volume 5e8c6f91-0c53-410b-a927-fada1c7cb1d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4', 'volume_size': 1, 'snapshot_id': '46218ec5-d50a-409c-bec1-8b09914d7c0b'} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Creating volume 5e8c6f91-0c53-410b-a927-fada1c7cb1d4 from snapshot 46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] snapshot: 46218ec5-d50a-409c-bec1-8b09914d7c0b, volume: 5e8c6f91-0c53-410b-a927-fada1c7cb1d4, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[242737f3-56dc-4378-a6ef-1e08990ee8b5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:38 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:38 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:38 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c876ce3a-4a31-415c-8068-ef5db56e20b4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:38 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:38 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:38 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:26:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:38 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 Nov 05 08:26:38 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e99514b3-c291-4ca2-9a5a-fe86381f95dc tempest-GroupSnapshotsV319Test-1382920055 None] Group tempest-GroupSnapshotsV319Test-Group-1045934966: creating Nov 05 08:26:47 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:26:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e99514b3-c291-4ca2-9a5a-fe86381f95dc tempest-GroupSnapshotsV319Test-1382920055 None] Group tempest-GroupSnapshotsV319Test-Group-1045934966: created successfully Nov 05 08:26:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e99514b3-c291-4ca2-9a5a-fe86381f95dc tempest-GroupSnapshotsV319Test-1382920055 None] Create group completed successfully. Nov 05 08:26:49 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" returned: 0 in 10.822s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:49 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd, size 1024.00 MB, duration 10.82 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:26:49 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Converted 1024.00 MB image at 94.61 MB/s Nov 05 08:26:49 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 is being set with open permissions: ugo+rw Nov 05 08:26:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:49 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 Nov 05 08:26:49 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Flow 'volume_create_manager' (246dfe43-7f2b-4a86-910b-cc75922cd755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd956f07-06fb-487f-b0fd-982568893a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd956f07-06fb-487f-b0fd-982568893a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1531506106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a65790-69b6-46c7-8561-b5673f56f2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6f3cc8b20541f0a4473fa444cabb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:50Z,use_quota=True,user_id='99bd45afc21146d882dca5b373d5a02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce77534-c6cd-4998-8dec-7609b4d4888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce77534-c6cd-4998-8dec-7609b4d4888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4719457-7845-4c6d-9dc5-a110f1d9a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4719457-7845-4c6d-9dc5-a110f1d9a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a65790-69b6-46c7-8561-b5673f56f2a3', 'volume_name': 'volume-85a65790-69b6-46c7-8561-b5673f56f2a3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f7d9b8-2731-4ed1-9ae6-90d3bbbaac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f7d9b8-2731-4ed1-9ae6-90d3bbbaac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bebc94-fbb7-4e26-9079-878062e3bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Volume 85a65790-69b6-46c7-8561-b5673f56f2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a65790-69b6-46c7-8561-b5673f56f2a3', 'volume_size': 1} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:50 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" released by "_copy_volume_from_snapshot" :: held 12.336s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" released by "_create_volume_from_snapshot" :: held 12.439s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.455s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.184s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1531506106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a65790-69b6-46c7-8561-b5673f56f2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6f3cc8b20541f0a4473fa444cabb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:50Z,use_quota=True,user_id='99bd45afc21146d882dca5b373d5a02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Creating volume 85a65790-69b6-46c7-8561-b5673f56f2a3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:50 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:50 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 1073741824 Nov 05 08:26:50 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7b256-c832-4174-9b14-a3b298480888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4', 'volume_size': 1, 'snapshot_id': '46218ec5-d50a-409c-bec1-8b09914d7c0b'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429423e7-2906-428e-be75-aad0ff89bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Volume volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 (5e8c6f91-0c53-410b-a927-fada1c7cb1d4): created successfully Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429423e7-2906-428e-be75-aad0ff89bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Flow 'volume_create_manager' (834928e3-949e-41f8-9c1a-3f2f1fbf9121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d458a17-4118-45d2-8571-e277ba2786fc tempest-VolumesDeleteCascade-517039318 None] Created volume successfully. Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Flow 'volume_create_manager' (96b5cd71-3909-4dc3-884f-a0e1ef543150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee92008-b6b5-4cbc-ac06-b3f167089b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee92008-b6b5-4cbc-ac06-b3f167089b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444377953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=859ce0e4-83e9-45c9-8d8f-14f9c0487757,host='devstack@QuobyteHD#QuobyteHD',id=8deb1ec9-9e32-4e4a-8f08-d791fa29e223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511828a98371456bb2a2d78451689ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:51Z,use_quota=True,user_id='b61916aab8d1413dadd749e9ab5349aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efad0616-0edc-4cde-905c-4873d58a4b72),volume_type_id=efad0616-0edc-4cde-905c-4873d58a4b72)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd68365c-023d-4ffd-9a11-b5523693bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd68365c-023d-4ffd-9a11-b5523693bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f745eb8c-0fda-4971-a22b-5ea3ac3f2cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f745eb8c-0fda-4971-a22b-5ea3ac3f2cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8deb1ec9-9e32-4e4a-8f08-d791fa29e223', 'volume_name': 'volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf84f66-fa20-430a-9fd0-29a424dc328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf84f66-fa20-430a-9fd0-29a424dc328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e965743e-2a96-4c9f-945a-949f8b7c812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Volume 8deb1ec9-9e32-4e4a-8f08-d791fa29e223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223', 'volume_size': 1} Nov 05 08:26:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:51 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 1073741824" returned: 0 in 0.621s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:51 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 Nov 05 08:26:51 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:51 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=859ce0e4-83e9-45c9-8d8f-14f9c0487757,created_at=2026-11-05T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444377953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=859ce0e4-83e9-45c9-8d8f-14f9c0487757,host='devstack@QuobyteHD#QuobyteHD',id=8deb1ec9-9e32-4e4a-8f08-d791fa29e223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511828a98371456bb2a2d78451689ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:26:51Z,use_quota=True,user_id='b61916aab8d1413dadd749e9ab5349aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efad0616-0edc-4cde-905c-4873d58a4b72),volume_type_id=efad0616-0edc-4cde-905c-4873d58a4b72)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Creating volume 8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:26:51 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bebc94-fbb7-4e26-9079-878062e3bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a65790-69b6-46c7-8561-b5673f56f2a3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:51 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 1073741824 Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eba74de-e783-41dd-956b-c1482b0e205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:51 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Volume volume-85a65790-69b6-46c7-8561-b5673f56f2a3 (85a65790-69b6-46c7-8561-b5673f56f2a3): created successfully Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eba74de-e783-41dd-956b-c1482b0e205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Flow 'volume_create_manager' (246dfe43-7f2b-4a86-910b-cc75922cd755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b93c6510-525c-4145-a228-7cb38165beec tempest-AttachVolumeShelveTestJSON-1352561379 None] Created volume successfully. Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-ebcfddb8-5733-4311-9679-e402a4ad6ddd-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-ebcfddb8-5733-4311-9679-e402a4ad6ddd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Performing cascade delete. {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-46218ec5-d50a-409c-bec1-8b09914d7c0b-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-46218ec5-d50a-409c-bec1-8b09914d7c0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Deleting offline snapshot 46218ec5-d50a-409c-bec1-8b09914d7c0b of volume ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] snapshot_file for this snap is: volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[856ee370-d973-4571-a436-7267e01e8e5c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:51 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:51 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:52 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 1073741824" returned: 0 in 0.769s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:52 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 Nov 05 08:26:52 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:52 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.521s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1300db-7ccd-43ca-8c53-aa97b62fb1fd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:52 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e965743e-2a96-4c9f-945a-949f8b7c812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1636a11e-5f3c-438a-9b2f-9e1c00f9615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:26:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Volume volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 (8deb1ec9-9e32-4e4a-8f08-d791fa29e223): created successfully Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1636a11e-5f3c-438a-9b2f-9e1c00f9615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:26:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Flow 'volume_create_manager' (96b5cd71-3909-4dc3-884f-a0e1ef543150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:26:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c541e584-5232-4ec9-9181-8f0a9035c9b6 tempest-GroupSnapshotsV319Test-1382920055 None] Created volume successfully. Nov 05 08:26:52 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:52 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:53 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.845s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:53 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:53 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] GroupSnapshot 354a0f3b-a410-461d-b358-f8553e13635e: creating. Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Group snapshot 354a0f3b-a410-461d-b358-f8553e13635e: creating. {{(pid=87092) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Creating offline snapshot aa709394-dda1-4849-9e8f-e6afbb71b0fc of volume 8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[810a2859-e5e2-469e-9371-34fe1d23bb8f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:53 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.648s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:53 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b Nov 05 08:26:53 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:54 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 Nov 05 08:26:54 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:54 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd.46218ec5-d50a-409c-bec1-8b09914d7c0b" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-46218ec5-d50a-409c-bec1-8b09914d7c0b" released by "_delete_snapshot" :: held 2.713s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" released by "delete_snapshot" :: held 2.743s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:54 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" returned: 0 in 0.728s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:54 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc 1G Nov 05 08:26:54 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Created reservations ['904d7a11-beeb-4d34-95bf-07fffb123f5d', 'c3738967-5086-4a0a-8d5c-86b07597a74f', '2a09589d-eecc-4ea1-a375-da8127955965', '544cd54d-c6fe-4f63-ae05-827206a58f5e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Delete snapshot completed successfully. Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-46218ec5-d50a-409c-bec1-8b09914d7c0b-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Snapshots deleted, issuing volume delete {{(pid=87092) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18dc283-97ff-405d-af0d-d7b22ab0cca4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:55 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:55 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:55 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc 1G" returned: 0 in 0.702s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:55 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc Nov 05 08:26:55 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:55 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:55 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd Nov 05 08:26:55 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:55 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:55 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:55 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ebcfddb8-5733-4311-9679-e402a4ad6ddd" returned: 0 in 0.293s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:55 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc Nov 05 08:26:55 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-ebcfddb8-5733-4311-9679-e402a4ad6ddd" released by "delete_volume" :: held 0.960s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Created reservations ['08e3a55f-aaf1-4c48-acfc-e69e3c8db4a4', '905a778d-468b-49ff-b542-bec4ddfbdf9b', '74b04f1d-3e9e-4cf2-ab05-6ec166d39e0f', 'bf2079f2-0f7c-4b92-940d-242512b0fb8b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:56 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:56 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:56 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:56 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info Nov 05 08:26:56 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-5e8c6f91-0c53-410b-a927-fada1c7cb1d4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-5e8c6f91-0c53-410b-a927-fada1c7cb1d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bbf07a-5119-410f-b687-88c2e293c2e8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:56 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Deleted volume successfully. Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-86e2bf0f-9145-4262-bc88-7062723af87b tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-ebcfddb8-5733-4311-9679-e402a4ad6ddd-delete_volume" released by "delete_volume" :: held 5.063s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:56 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info" returned: 0 in 0.547s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:56 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:26:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:56 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info Nov 05 08:26:56 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:56 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 Nov 05 08:26:56 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:57 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.info" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:57 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:57 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4 Nov 05 08:26:57 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9df60931-8b7d-47bb-8fb1-5255c857d225 tempest-GroupSnapshotsV319Test-1382920055 None] group_snapshot 354a0f3b-a410-461d-b358-f8553e13635e: created successfully Nov 05 08:26:57 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-quobyte-5e8c6f91-0c53-410b-a927-fada1c7cb1d4" released by "delete_volume" :: held 0.900s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Created reservations ['497134f1-eec1-42a8-909d-458df82188ab', 'bbfface3-7d25-4923-a3f7-b6a9e8365321', '9ece23a9-8dfd-4ba9-ba06-45c58eae0058', '402ed65a-62f2-4e1b-a28e-10afe328f13b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:26:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:57 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:26:57 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:57 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:26:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Deleted volume successfully. Nov 05 08:26:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f5f120a-f830-4415-8aa4-8990ec52deaf tempest-VolumesDeleteCascade-517039318 None] Lock "cinder-5e8c6f91-0c53-410b-a927-fada1c7cb1d4-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:26:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] group_snapshot 354a0f3b-a410-461d-b358-f8553e13635e: deleting Nov 05 08:26:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] group_snapshot 354a0f3b-a410-461d-b358-f8553e13635e: deleting {{(pid=87092) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "cinder-quobyte-aa709394-dda1-4849-9e8f-e6afbb71b0fc" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-aa709394-dda1-4849-9e8f-e6afbb71b0fc" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Deleting offline snapshot aa709394-dda1-4849-9e8f-e6afbb71b0fc of volume 8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] snapshot_file for this snap is: volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1071662-2aa3-414c-afad-f94b91141fca]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:59 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc Nov 05 08:26:59 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:26:59 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b6a05-2e0f-4de0-8c08-77221913ecbb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:26:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:26:59 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 Nov 05 08:26:59 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:00 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" returned: 0 in 0.609s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:00 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc Nov 05 08:27:00 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:00 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:00 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc Nov 05 08:27:00 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:01 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223.aa709394-dda1-4849-9e8f-e6afbb71b0fc" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-aa709394-dda1-4849-9e8f-e6afbb71b0fc" released by "_delete_snapshot" :: held 2.218s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" released by "delete_snapshot" :: held 2.274s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:01 devstack cinder-volume[87092]: WARNING cinder.quota [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-393549766 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-393549766, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:27:01 devstack cinder-volume[87092]: WARNING cinder.quota [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-393549766 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-393549766, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:27:01 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] Created reservations ['c4b32071-7e36-4f8e-a665-913cc33ec2c6', '09408de3-1fe8-43f1-85a4-c598d6f84279', '97c609d2-08de-477d-8bfd-be382711a8ad', '94648de4-bb6a-46f8-a3fd-da182e17505a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-05cba15b-a5a1-45ac-b095-c706414063f1 tempest-GroupSnapshotsV319Test-1382920055 None] group_snapshot 354a0f3b-a410-461d-b358-f8553e13635e: deleted successfully Nov 05 08:27:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06d107a-d8c1-48ab-aa71-21414b9047c2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:03 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 Nov 05 08:27:03 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:03 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:03 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223 Nov 05 08:27:03 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:03 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Lock "cinder-quobyte-8deb1ec9-9e32-4e4a-8f08-d791fa29e223" released by "delete_volume" :: held 0.804s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Created reservations ['3768853f-ffca-48e1-a0bb-09a7fb8e9d03'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:03 devstack cinder-volume[87092]: WARNING cinder.quota [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-393549766 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-393549766, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Created reservations ['ee48d607-af54-4a45-b0de-9c9e83ce3d55', '86dee805-096f-490f-bde7-b563191129f7', '9e248eb3-e7f1-40d2-b7b0-15474ff93046', '9bb717d0-b56f-4f2b-a381-6711f97ff4cb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:04 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:04 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-21fe54a1-3b58-475a-9ed7-f4b0f008acfa req-00fd5edc-4d44-4a9a-a3f3-fba511d151ab tempest-AttachVolumeShelveTestJSON-1352561379 None] No connector for attachment 4f2b8f84-cf65-4572-8e08-620443d50363; skipping storage backend terminate_connection call. {{(pid=87092) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-21fe54a1-3b58-475a-9ed7-f4b0f008acfa req-00fd5edc-4d44-4a9a-a3f3-fba511d151ab tempest-AttachVolumeShelveTestJSON-1352561379 None] Deleting attachment 4f2b8f84-cf65-4572-8e08-620443d50363. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:27:04 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.312s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b241bd74-6fa3-42e8-9656-0ada9ae8699f tempest-GroupSnapshotsV319Test-1382920055 None] Delete group completed successfully. Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Flow 'volume_create_manager' (99dbfec6-40cd-4f1c-8eeb-6c6ef9527a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b2d640-1492-4816-9711-1e56d0f2980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b2d640-1492-4816-9711-1e56d0f2980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-243202456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2643033d-fa80-42f8-824e-7de0d4ac145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94fc90a3b21246b8b09775c0360e0049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:05Z,use_quota=True,user_id='dd268978189442ce82d50ce06588ba06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dde47e-7bb5-4dfd-adee-a8844ad63e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dde47e-7bb5-4dfd-adee-a8844ad63e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03577933-3adf-424d-9a13-f6d337d68f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03577933-3adf-424d-9a13-f6d337d68f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2643033d-fa80-42f8-824e-7de0d4ac145c', 'volume_name': 'volume-2643033d-fa80-42f8-824e-7de0d4ac145c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0e4e6c-f27e-43cc-8400-fcfa7ab3dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0e4e6c-f27e-43cc-8400-fcfa7ab3dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed5a7e-0d6e-45f1-aa84-66adf33c3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Volume 2643033d-fa80-42f8-824e-7de0d4ac145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2643033d-fa80-42f8-824e-7de0d4ac145c', 'volume_size': 1} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-243202456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2643033d-fa80-42f8-824e-7de0d4ac145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94fc90a3b21246b8b09775c0360e0049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:05Z,use_quota=True,user_id='dd268978189442ce82d50ce06588ba06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Creating volume 2643033d-fa80-42f8-824e-7de0d4ac145c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:05 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c 1073741824 Nov 05 08:27:05 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:06 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c 1073741824" returned: 0 in 0.560s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:06 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c Nov 05 08:27:06 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:06 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ed5a7e-0d6e-45f1-aa84-66adf33c3a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2643033d-fa80-42f8-824e-7de0d4ac145c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e67bd0-e8ab-4764-b4fd-2af7e9dba324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Volume volume-2643033d-fa80-42f8-824e-7de0d4ac145c (2643033d-fa80-42f8-824e-7de0d4ac145c): created successfully Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e67bd0-e8ab-4764-b4fd-2af7e9dba324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Flow 'volume_create_manager' (99dbfec6-40cd-4f1c-8eeb-6c6ef9527a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a2aa0a52-19f0-43e9-8b84-3f9e7b08ed4d tempest-VolumesTransfersTest-468994503 None] Created volume successfully. Nov 05 08:27:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-452937f7-d175-4ad5-9f7b-6b34c2855463 tempest-VolumesTransfersTest-1004020950 None] Transfer volume completed successfully. Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "cinder-2643033d-fa80-42f8-824e-7de0d4ac145c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-2643033d-fa80-42f8-824e-7de0d4ac145c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "cinder-quobyte-2643033d-fa80-42f8-824e-7de0d4ac145c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-quobyte-2643033d-fa80-42f8-824e-7de0d4ac145c" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c774f-6be2-4e44-95c6-4c98bf541a53]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:10 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c Nov 05 08:27:10 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:10 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:10 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c Nov 05 08:27:10 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:10 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2643033d-fa80-42f8-824e-7de0d4ac145c" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-quobyte-2643033d-fa80-42f8-824e-7de0d4ac145c" released by "delete_volume" :: held 1.044s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Created reservations ['b12afbad-d600-4145-913e-6b006dc9f59a', '35b2f8e0-56cd-4312-a712-4b344876bba0', '9f854c53-a8ee-44f9-bccd-00d29e419c8c', '2e28101e-0b64-4717-8747-95fbf13bb0e9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:11 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:11 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:11 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Deleted volume successfully. Nov 05 08:27:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7d67a7b4-4cf6-467f-8c34-fb7f4e40a6ff tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-2643033d-fa80-42f8-824e-7de0d4ac145c-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Flow 'volume_create_manager' (fcabd8c9-2513-48f0-8bcb-aba3570b943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c722e77-4f9e-4a18-aa15-13247f4f8b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c722e77-4f9e-4a18-aa15-13247f4f8b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-258086672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e317478b-2eaf-4e3b-8ca9-c22159fc74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94fc90a3b21246b8b09775c0360e0049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='dd268978189442ce82d50ce06588ba06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b5dbb-8f5f-45b4-ae0b-0d27839dd789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b5dbb-8f5f-45b4-ae0b-0d27839dd789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ac2866-c2e2-4ec1-a8ef-1567c5de030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ac2866-c2e2-4ec1-a8ef-1567c5de030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e317478b-2eaf-4e3b-8ca9-c22159fc74ce', 'volume_name': 'volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219e517-9c67-4fad-bc12-516ed0ff4e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219e517-9c67-4fad-bc12-516ed0ff4e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d691a61-02db-4130-b82c-76775b4613ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Volume e317478b-2eaf-4e3b-8ca9-c22159fc74ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce', 'volume_size': 1} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-258086672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e317478b-2eaf-4e3b-8ca9-c22159fc74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94fc90a3b21246b8b09775c0360e0049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:13Z,use_quota=True,user_id='dd268978189442ce82d50ce06588ba06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Creating volume e317478b-2eaf-4e3b-8ca9-c22159fc74ce {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:12 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:12 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce 1073741824 Nov 05 08:27:12 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:13 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce 1073741824" returned: 0 in 0.571s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:13 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce Nov 05 08:27:13 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:13 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d691a61-02db-4130-b82c-76775b4613ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89abeae-9ec0-488f-b36d-eb9b5c255206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Volume volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce (e317478b-2eaf-4e3b-8ca9-c22159fc74ce): created successfully Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89abeae-9ec0-488f-b36d-eb9b5c255206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Flow 'volume_create_manager' (fcabd8c9-2513-48f0-8bcb-aba3570b943a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a78de541-5b2c-46a6-9a3d-c6c0a9289013 tempest-VolumesTransfersTest-468994503 None] Created volume successfully. Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (4e279327-41ed-4351-b250-4b5d120213b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cd2cc-2e10-4342-a666-0831c2e09e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "cinder-e317478b-2eaf-4e3b-8ca9-c22159fc74ce-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cd2cc-2e10-4342-a666-0831c2e09e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2065754427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915b571e-1a72-4e26-9afe-5ceec0db5f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:14Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680793bb-f6ff-4674-8a20-f54920cda978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680793bb-f6ff-4674-8a20-f54920cda978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0302ad91-5cfc-4cff-a98b-7fe3db40952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0302ad91-5cfc-4cff-a98b-7fe3db40952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915b571e-1a72-4e26-9afe-5ceec0db5f21', 'volume_name': 'volume-915b571e-1a72-4e26-9afe-5ceec0db5f21', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6588492-7c4d-4a47-9c85-17b45da50f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6588492-7c4d-4a47-9c85-17b45da50f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36c1de-7b7a-47c9-b0d2-a5ab50045e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:14 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Volume 915b571e-1a72-4e26-9afe-5ceec0db5f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915b571e-1a72-4e26-9afe-5ceec0db5f21', 'volume_size': 1} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2065754427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915b571e-1a72-4e26-9afe-5ceec0db5f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:14Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Creating volume 915b571e-1a72-4e26-9afe-5ceec0db5f21 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:14 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-e317478b-2eaf-4e3b-8ca9-c22159fc74ce-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:14 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 1073741824 Nov 05 08:27:14 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "cinder-quobyte-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-quobyte-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8e5763-beaa-4108-b258-7bd944aea805]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:14 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce Nov 05 08:27:14 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:15 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 1073741824" returned: 0 in 0.679s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:15 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:15 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce Nov 05 08:27:15 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:15 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 Nov 05 08:27:15 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:15 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:15 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" returned: 0 in 0.650s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d36c1de-7b7a-47c9-b0d2-a5ab50045e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915b571e-1a72-4e26-9afe-5ceec0db5f21', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e37958-51fb-419e-8222-d1c7e31b9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-quobyte-e317478b-2eaf-4e3b-8ca9-c22159fc74ce" released by "delete_volume" :: held 1.292s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Volume volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 (915b571e-1a72-4e26-9afe-5ceec0db5f21): created successfully Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e37958-51fb-419e-8222-d1c7e31b9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (4e279327-41ed-4351-b250-4b5d120213b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ffbb65f7-f951-4b9a-8aab-388884e80200 tempest-AttachVolumeNegativeTest-88548250 None] Created volume successfully. Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Created reservations ['cbad1ea9-d4ae-41ad-96d1-d92d3a23fe9c', '6f14685d-09ed-467d-8547-52c95903b1ed', '471b6b1a-38c9-4f9d-a6d7-23a2988569f4', 'f7b92a50-9b74-41bf-a911-5a4f4e4319a2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:16 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:16 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:16 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.527s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Deleted volume successfully. Nov 05 08:27:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d21a6d1e-d8c6-43d7-929b-9b790c6e5582 tempest-VolumesTransfersTest-1966754966 None] Lock "cinder-e317478b-2eaf-4e3b-8ca9-c22159fc74ce-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8815fedb-b326-4f60-8f8f-c00b30461877 req-ce95d425-152e-4dc8-a835-cb3d51121c3f tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8815fedb-b326-4f60-8f8f-c00b30461877 req-ce95d425-152e-4dc8-a835-cb3d51121c3f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-8815fedb-b326-4f60-8f8f-c00b30461877 req-ce95d425-152e-4dc8-a835-cb3d51121c3f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-8815fedb-b326-4f60-8f8f-c00b30461877 req-ce95d425-152e-4dc8-a835-cb3d51121c3f tempest-AttachVolumeNegativeTest-88548250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-915b571e-1a72-4e26-9afe-5ceec0db5f21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8911229-fb90-45db-aab5-fb5cb84b861a', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:18 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:18 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-8815fedb-b326-4f60-8f8f-c00b30461877 req-ce95d425-152e-4dc8-a835-cb3d51121c3f tempest-AttachVolumeNegativeTest-88548250 None] attachment_update completed successfully. Nov 05 08:27:18 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.603s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:27:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:27:21 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=113,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:27:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-fec59dcf-2d2e-45bd-8a2e-5c12f6225d9b req-1cee616e-2a3e-447c-a952-b4f0a88412fc tempest-AttachVolumeNegativeTest-88548250 None] Terminate volume connection completed successfully. Nov 05 08:27:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-fec59dcf-2d2e-45bd-8a2e-5c12f6225d9b req-1cee616e-2a3e-447c-a952-b4f0a88412fc tempest-AttachVolumeNegativeTest-88548250 None] Deleting attachment c8911229-fb90-45db-aab5-fb5cb84b861a. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Flow 'volume_create_manager' (0846e672-19c0-4dd6-8cc6-504e4e6920c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774987b0-9de9-45ae-8ac8-66733747a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774987b0-9de9-45ae-8ac8-66733747a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-391686087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e217aae-5e64-419a-8c18-108baf9b8726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee4d68d195645c2b79497f5b190196b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:23Z,use_quota=True,user_id='c11f61c0c7784accb3a12f36e4ffbdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c753800b-4b71-4b87-b89d-5563bae42999),volume_type_id=c753800b-4b71-4b87-b89d-5563bae42999)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b8826f-2371-4ea1-9b1f-3435bd29c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b8826f-2371-4ea1-9b1f-3435bd29c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7482cb10-f991-4960-80a4-3d8a2e18aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7482cb10-f991-4960-80a4-3d8a2e18aed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e217aae-5e64-419a-8c18-108baf9b8726', 'volume_name': 'volume-2e217aae-5e64-419a-8c18-108baf9b8726', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc87bf9-428e-4f0c-8cec-f54c5c407424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc87bf9-428e-4f0c-8cec-f54c5c407424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e948ddc7-72fa-4ff7-9d8b-713b27f76030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Volume 2e217aae-5e64-419a-8c18-108baf9b8726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e217aae-5e64-419a-8c18-108baf9b8726', 'volume_size': 1} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-391686087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e217aae-5e64-419a-8c18-108baf9b8726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dee4d68d195645c2b79497f5b190196b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:23Z,use_quota=True,user_id='c11f61c0c7784accb3a12f36e4ffbdbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c753800b-4b71-4b87-b89d-5563bae42999),volume_type_id=c753800b-4b71-4b87-b89d-5563bae42999)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Creating volume 2e217aae-5e64-419a-8c18-108baf9b8726 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:23 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 1073741824 Nov 05 08:27:23 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:23 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 1073741824" returned: 0 in 0.605s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:23 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 Nov 05 08:27:23 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:24 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726" returned: 0 in 0.446s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e948ddc7-72fa-4ff7-9d8b-713b27f76030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e217aae-5e64-419a-8c18-108baf9b8726', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69505c-3fec-438b-bd40-cbc0959cc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Volume volume-2e217aae-5e64-419a-8c18-108baf9b8726 (2e217aae-5e64-419a-8c18-108baf9b8726): created successfully Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69505c-3fec-438b-bd40-cbc0959cc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Flow 'volume_create_manager' (0846e672-19c0-4dd6-8cc6-504e4e6920c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-84a5e04c-f44c-4c81-ad8e-268ea90a2065 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Created volume successfully. Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:25 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:25 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:25 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ffee8d3c-8664-4832-93d0-5f245fb417e6 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Retype volume completed successfully. Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Flow 'volume_create_manager' (6449ad00-3d50-473a-b340-dad7bcbfb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea4419-cfd4-4b24-9498-f2d55c7d9a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea4419-cfd4-4b24-9498-f2d55c7d9a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-282572132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d9959a-41c8-4971-9e0e-e25e5180446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5162aad28e5b4756bdaa385b47f5bc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:27Z,use_quota=True,user_id='e207b20182cb4ede852893a88c0487d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d6a9d6-5255-43df-be95-3a9d67c00bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d6a9d6-5255-43df-be95-3a9d67c00bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d4e49-af1c-4f31-9510-9e848de90e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d4e49-af1c-4f31-9510-9e848de90e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d9959a-41c8-4971-9e0e-e25e5180446a', 'volume_name': 'volume-f2d9959a-41c8-4971-9e0e-e25e5180446a', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59c90a0-b90d-4ec1-a075-294b3cb4c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59c90a0-b90d-4ec1-a075-294b3cb4c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2af18a-ed1d-4422-96dd-f8a750cd80b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Volume f2d9959a-41c8-4971-9e0e-e25e5180446a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d9959a-41c8-4971-9e0e-e25e5180446a', 'volume_size': 2} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-282572132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d9959a-41c8-4971-9e0e-e25e5180446a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5162aad28e5b4756bdaa385b47f5bc60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:27Z,use_quota=True,user_id='e207b20182cb4ede852893a88c0487d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Creating volume f2d9959a-41c8-4971-9e0e-e25e5180446a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a 2147483648 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:26 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a 2147483648 Nov 05 08:27:26 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "cinder-2e217aae-5e64-419a-8c18-108baf9b8726-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "cinder-2e217aae-5e64-419a-8c18-108baf9b8726-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "cinder-quobyte-2e217aae-5e64-419a-8c18-108baf9b8726" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "cinder-quobyte-2e217aae-5e64-419a-8c18-108baf9b8726" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1efe26-1fe7-4a3a-9976-b0e143b2f689]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:27 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 Nov 05 08:27:27 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:27 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a 2147483648" returned: 0 in 0.640s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:27 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a Nov 05 08:27:27 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:27 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:27 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2af18a-ed1d-4422-96dd-f8a750cd80b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d9959a-41c8-4971-9e0e-e25e5180446a', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:27 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726 Nov 05 08:27:27 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71df580d-1564-4407-9d46-694270c3cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Volume volume-f2d9959a-41c8-4971-9e0e-e25e5180446a (f2d9959a-41c8-4971-9e0e-e25e5180446a): created successfully Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71df580d-1564-4407-9d46-694270c3cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Flow 'volume_create_manager' (6449ad00-3d50-473a-b340-dad7bcbfb26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-52260627-6cd4-484b-acf0-d7fa1e35fca0 tempest-VolumesCloneNegativeTest-372707380 None] Created volume successfully. Nov 05 08:27:28 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e217aae-5e64-419a-8c18-108baf9b8726" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "cinder-quobyte-2e217aae-5e64-419a-8c18-108baf9b8726" released by "delete_volume" :: held 0.951s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:28 devstack cinder-volume[87092]: WARNING cinder.quota [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:27:28 devstack cinder-volume[87092]: WARNING cinder.quota [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Created reservations ['8572b964-9054-4487-83f3-8ddf4dda180e', '39d7c9f7-0467-41d1-8315-90ff05bbab39', '46428d92-12f6-4858-a277-f6bcae221898', '53dd7a92-195d-46dc-9362-3ae4eadddb62'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:28 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:28 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:28 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Deleted volume successfully. Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b14eefe8-d5a2-47f5-93a1-c0545909c201 tempest-VolumeRetypeWithoutMigrationTest-1359650094 None] Lock "cinder-2e217aae-5e64-419a-8c18-108baf9b8726-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Acquiring lock "cinder-f2d9959a-41c8-4971-9e0e-e25e5180446a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "cinder-f2d9959a-41c8-4971-9e0e-e25e5180446a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Acquiring lock "cinder-quobyte-f2d9959a-41c8-4971-9e0e-e25e5180446a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "cinder-quobyte-f2d9959a-41c8-4971-9e0e-e25e5180446a" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f695a4-0a55-4bcd-bf01-686a7771470f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:29 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a Nov 05 08:27:29 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:29 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:29 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a Nov 05 08:27:29 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:29 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2d9959a-41c8-4971-9e0e-e25e5180446a" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "cinder-quobyte-f2d9959a-41c8-4971-9e0e-e25e5180446a" released by "delete_volume" :: held 0.775s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Created reservations ['a677de9b-047f-420f-ac29-997c3e5a7daf', 'd8d35c02-198a-4825-ac81-15ac6ad56146', 'f656115a-2bc2-4589-8dc8-ee0b465dc10e', '12b28f51-704d-4d08-9bc0-a77baa040ccb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:30 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:30 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:30 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Deleted volume successfully. Nov 05 08:27:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-43a700c8-ecc1-4db1-8d8e-41e09d36f128 tempest-VolumesCloneNegativeTest-372707380 None] Lock "cinder-f2d9959a-41c8-4971-9e0e-e25e5180446a-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Flow 'volume_create_manager' (69dec0bf-68a8-4b96-916e-4eb87dca1193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92981a79-ce89-4281-81a8-4fd594956061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92981a79-ce89-4281-81a8-4fd594956061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-797907967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ce013a-8925-4d2c-8135-870c732d4112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f29e0f783f44641a26753c8823165f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:35Z,use_quota=True,user_id='5a5b834e517446e28f86914d600c2149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c53b62b-699d-49eb-9fd1-a2cd6f52c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c53b62b-699d-49eb-9fd1-a2cd6f52c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9050fb4-a8cf-44dd-b218-c958c2135c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9050fb4-a8cf-44dd-b218-c958c2135c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33ce013a-8925-4d2c-8135-870c732d4112', 'volume_name': 'volume-33ce013a-8925-4d2c-8135-870c732d4112', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306faf57-aceb-4789-b16c-d4b8fbe1234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306faf57-aceb-4789-b16c-d4b8fbe1234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8dc73e-71b5-4fc7-a446-3f855507394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Volume 33ce013a-8925-4d2c-8135-870c732d4112: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33ce013a-8925-4d2c-8135-870c732d4112', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:27:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Trying to clone 33ce013a-8925-4d2c-8135-870c732d4112 from image 9dbb82da-9633-4e04-9ee8-18373a09d135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:27:36 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:27:36 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:27:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c91f01-cfda-4457-94d7-eeb27befef11]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:36 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD Nov 05 08:27:36 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:37 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Flow 'volume_create_manager' (5748c54f-18ad-4ae8-a145-cc50a5f4af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2907a4f-1e5b-411d-95aa-3e6aa2eb02d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 is fetched for user 5a5b834e517446e28f86914d600c2149. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2907a4f-1e5b-411d-95aa-3e6aa2eb02d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1092310619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c67b036-069c-4ff6-9be0-e74a8753ad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734e017c427f45e48ee5cf885e1f7f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:37Z,use_quota=True,user_id='c7c9f1ff23334031ae7705095dea3710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d5ea3-5fea-4906-8c96-9f55ddb40e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255d5ea3-5fea-4906-8c96-9f55ddb40e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb4e98f-8338-4156-83a1-c48bf547ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb4e98f-8338-4156-83a1-c48bf547ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c67b036-069c-4ff6-9be0-e74a8753ad95', 'volume_name': 'volume-9c67b036-069c-4ff6-9be0-e74a8753ad95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75a930c-da88-4ce7-956e-ee04a590ab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75a930c-da88-4ce7-956e-ee04a590ab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348aab88-7047-4023-a8c7-84cb41f16329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Volume 9c67b036-069c-4ff6-9be0-e74a8753ad95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c67b036-069c-4ff6-9be0-e74a8753ad95', 'volume_size': 1} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1092310619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c67b036-069c-4ff6-9be0-e74a8753ad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='734e017c427f45e48ee5cf885e1f7f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:37Z,use_quota=True,user_id='c7c9f1ff23334031ae7705095dea3710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Creating volume 9c67b036-069c-4ff6-9be0-e74a8753ad95 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:37 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 1073741824 Nov 05 08:27:37 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[facc9830-7d5a-47e6-9619-ef7fb19934da]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:37 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD Nov 05 08:27:37 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:38 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD" returned: 0 in 1.024s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:38 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 1073741824" returned: 0 in 1.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:38 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 Nov 05 08:27:38 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:38 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-797907967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ce013a-8925-4d2c-8135-870c732d4112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f29e0f783f44641a26753c8823165f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:35Z,use_quota=True,user_id='5a5b834e517446e28f86914d600c2149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Creating volume 33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:39 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1073741824 Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348aab88-7047-4023-a8c7-84cb41f16329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c67b036-069c-4ff6-9be0-e74a8753ad95', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:39 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f325bb-914b-4c2d-8840-e81a28816b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Volume volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 (9c67b036-069c-4ff6-9be0-e74a8753ad95): created successfully Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f325bb-914b-4c2d-8840-e81a28816b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Flow 'volume_create_manager' (5748c54f-18ad-4ae8-a145-cc50a5f4af09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-92711852-1f4a-49a5-8d7f-ea898ec88f26 tempest-VolumesServicesTestJSON-768220397 None] Created volume successfully. Nov 05 08:27:39 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1073741824" returned: 0 in 0.948s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:40 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 Nov 05 08:27:40 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:40 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Attempting download of 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 33ce013a-8925-4d2c-8135-870c732d4112. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d14656-18ab-41d2-8093-52c58102c8c2]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Acquiring lock "cinder-9c67b036-069c-4ff6-9be0-e74a8753ad95-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "cinder-9c67b036-069c-4ff6-9be0-e74a8753ad95-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:40 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx Nov 05 08:27:40 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Acquiring lock "cinder-quobyte-9c67b036-069c-4ff6-9be0-e74a8753ad95" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "cinder-quobyte-9c67b036-069c-4ff6-9be0-e74a8753ad95" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0e384f-0144-4a9c-9dbd-49fc25c93eef]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:41 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:41 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 Nov 05 08:27:41 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:41 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx Nov 05 08:27:41 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:41 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx" returned: 1 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_p3vftslx' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f3fb2-1fef-4f16-a3a6-e28849543722]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:41 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95" returned: 0 in 0.901s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:41 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95 Nov 05 08:27:41 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:42 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD Nov 05 08:27:42 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:42 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9c67b036-069c-4ff6-9be0-e74a8753ad95" returned: 0 in 0.562s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:42 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] 9dbb82da-9633-4e04-9ee8-18373a09d135 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "cinder-quobyte-9c67b036-069c-4ff6-9be0-e74a8753ad95" released by "delete_volume" :: held 1.606s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:42 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 Nov 05 08:27:42 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Created reservations ['e4a187fb-5ec0-4873-8cfc-febbac8968f9', '92f5d448-be0d-4c4e-8fbb-2a4c6ed66d9f', '042d331d-b748-4383-b3e1-e5e2193f2fa8', '347e0f05-a6b8-4153-9aca-6da70e12c38e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:42 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:42 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:43 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Deleted volume successfully. Nov 05 08:27:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e205af87-748a-448f-8f90-d17f06bb90ac tempest-VolumesServicesTestJSON-768220397 None] Lock "cinder-9c67b036-069c-4ff6-9be0-e74a8753ad95-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:45 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112" returned: 0 in 2.861s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_v8tr6r0udevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:27:45 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Converted 112.00 MB image at 39.13 MB/s Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:45 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1G Nov 05 08:27:45 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:45 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 1G" returned: 0 in 0.525s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Downloaded image 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 33ce013a-8925-4d2c-8135-870c732d4112 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 for user 5a5b834e517446e28f86914d600c2149 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Marking volume 33ce013a-8925-4d2c-8135-870c732d4112 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Copying metadata from image 9dbb82da-9633-4e04-9ee8-18373a09d135 to 33ce013a-8925-4d2c-8135-870c732d4112. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:27:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Creating volume glance metadata for volume 33ce013a-8925-4d2c-8135-870c732d4112 backed by image 9dbb82da-9633-4e04-9ee8-18373a09d135 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8dc73e-71b5-4fc7-a446-3f855507394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ce013a-8925-4d2c-8135-870c732d4112', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6dd355-1053-4927-a7fe-141c4318f197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Volume volume-33ce013a-8925-4d2c-8135-870c732d4112 (33ce013a-8925-4d2c-8135-870c732d4112): created successfully Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6dd355-1053-4927-a7fe-141c4318f197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Flow 'volume_create_manager' (69dec0bf-68a8-4b96-916e-4eb87dca1193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-89c991c6-0de5-489c-b4d0-727c004e4db6 tempest-VolumesExtendTest-1613253806 None] Created volume successfully. Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Acquiring lock "cinder-85a65790-69b6-46c7-8561-b5673f56f2a3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "cinder-85a65790-69b6-46c7-8561-b5673f56f2a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Acquiring lock "cinder-quobyte-85a65790-69b6-46c7-8561-b5673f56f2a3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "cinder-quobyte-85a65790-69b6-46c7-8561-b5673f56f2a3" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f612118c-3528-4f7e-bea5-b4b4723a1fdf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:46 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 Nov 05 08:27:46 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b34a2a5-7548-4889-99c8-c8ea823bba5c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:47 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 Nov 05 08:27:47 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:47 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3" returned: 0 in 0.640s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:47 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3 Nov 05 08:27:47 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:47 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112" returned: 0 in 0.530s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:47 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-85a65790-69b6-46c7-8561-b5673f56f2a3" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "cinder-quobyte-85a65790-69b6-46c7-8561-b5673f56f2a3" released by "delete_volume" :: held 1.044s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 2G" returned: 0 in 0.145s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.714s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Created reservations ['cc2dd4d1-85ca-45e2-bf7a-c89286ce083d', '1fdfcba2-cc5b-4e37-8eb6-d7ba54386f9b', '4f42f0cd-187e-4c3a-88e1-f80ceab171fa', 'f669b6b1-e1fc-4e01-988c-cb1655c22501'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a8bb8524-cf2a-40d1-a1ce-fc167347e948 tempest-VolumesExtendTest-1613253806 None] Extend volume completed successfully. Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:47 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:47 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:48 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Deleted volume successfully. Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9605e2d7-b316-4982-acf2-25d8a7cb4ffb tempest-AttachVolumeShelveTestJSON-1352561379 None] Lock "cinder-85a65790-69b6-46c7-8561-b5673f56f2a3-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-33ce013a-8925-4d2c-8135-870c732d4112-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "cinder-33ce013a-8925-4d2c-8135-870c732d4112-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=139,cinder:SELECT=104,cinder:DELETE=6,cinder:INSERT=35 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-quobyte-33ce013a-8925-4d2c-8135-870c732d4112" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-33ce013a-8925-4d2c-8135-870c732d4112" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57eacca-e3ff-43b7-9cc3-c255baab895e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:48 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 Nov 05 08:27:48 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:49 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:49 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112 Nov 05 08:27:49 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:49 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-33ce013a-8925-4d2c-8135-870c732d4112" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-33ce013a-8925-4d2c-8135-870c732d4112" released by "delete_volume" :: held 0.788s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Created reservations ['ba2411e1-2868-45b4-9f16-238dfa5782e9', '0d5f5aac-64c7-46cc-9796-1fd4ce218b23', '652ed4f1-602d-477a-bdbc-403bbe361845', '962e3946-9175-45b5-8023-9e2724ea857b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:49 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:27:49 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:50 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.579s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:27:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Deleted volume successfully. Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2049821f-0512-4c7a-b184-ea83e1d55d5b tempest-VolumesExtendTest-1613253806 None] Lock "cinder-33ce013a-8925-4d2c-8135-870c732d4112-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Flow 'volume_create_manager' (afb70cc6-15fc-4284-94eb-29c18fc476cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42f095-c4f9-4299-8a01-3377d0366eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42f095-c4f9-4299-8a01-3377d0366eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1885388820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b57c1f-94b0-4915-b68c-acaf837c726c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f29e0f783f44641a26753c8823165f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:51Z,use_quota=True,user_id='5a5b834e517446e28f86914d600c2149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32df64c5-232a-4f04-ac60-514569576f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32df64c5-232a-4f04-ac60-514569576f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30a01ac-289d-4d4d-9def-82467884dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30a01ac-289d-4d4d-9def-82467884dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b57c1f-94b0-4915-b68c-acaf837c726c', 'volume_name': 'volume-54b57c1f-94b0-4915-b68c-acaf837c726c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d95ad5-54ec-4008-8207-a357f2caa2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d95ad5-54ec-4008-8207-a357f2caa2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd846964-9c89-4f51-89b7-9115a28c431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Volume 54b57c1f-94b0-4915-b68c-acaf837c726c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b57c1f-94b0-4915-b68c-acaf837c726c', 'volume_size': 1} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1885388820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b57c1f-94b0-4915-b68c-acaf837c726c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f29e0f783f44641a26753c8823165f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:51Z,use_quota=True,user_id='5a5b834e517446e28f86914d600c2149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Creating volume 54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:50 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:50 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c 1073741824 Nov 05 08:27:50 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:51 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c 1073741824" returned: 0 in 0.744s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:51 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:27:51 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:51 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd846964-9c89-4f51-89b7-9115a28c431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b57c1f-94b0-4915-b68c-acaf837c726c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91044ac5-d2dd-4b15-ae43-60fc6b1e5026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Volume volume-54b57c1f-94b0-4915-b68c-acaf837c726c (54b57c1f-94b0-4915-b68c-acaf837c726c): created successfully Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91044ac5-d2dd-4b15-ae43-60fc6b1e5026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Flow 'volume_create_manager' (afb70cc6-15fc-4284-94eb-29c18fc476cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-466e3aff-46b7-471d-b876-9f4cad4c3378 tempest-VolumesExtendTest-1613253806 None] Created volume successfully. Nov 05 08:27:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Creating offline snapshot 1d527683-0412-458d-a632-61bb422e909b of volume 54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:27:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e32d0-d8a6-4ba1-94cd-ba828cd4de25]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:27:53 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:53 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b 1G Nov 05 08:27:53 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:53 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b 1G" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b57c1f-94b0-4915-b68c-acaf837c726c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:53 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b57c1f-94b0-4915-b68c-acaf837c726c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b Nov 05 08:27:53 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:54 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54b57c1f-94b0-4915-b68c-acaf837c726c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:54 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b is being set with open permissions: ugo+rw Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:54 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b Nov 05 08:27:54 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:54 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:54 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info Nov 05 08:27:54 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:54 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:54 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info is being set with open permissions: ugo+rw Nov 05 08:27:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:54 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info Nov 05 08:27:54 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:55 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.info" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-da421b57-0dbf-4c62-916f-923e4701b74c tempest-VolumesExtendTest-1613253806 None] Create snapshot completed successfully Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6263302-2c88-4467-9bd8-3fee7a8f8a7b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:56 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:27:56 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:56 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b 2G" returned: 0 in 0.169s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.615s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8f93d131-6cf9-46e5-9a83-21b45d486cda tempest-VolumesExtendTest-1613253806 None] Extend volume completed successfully. Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-1d527683-0412-458d-a632-61bb422e909b-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-1d527683-0412-458d-a632-61bb422e909b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-quobyte-1d527683-0412-458d-a632-61bb422e909b" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-1d527683-0412-458d-a632-61bb422e909b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Deleting offline snapshot 1d527683-0412-458d-a632-61bb422e909b of volume 54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] snapshot_file for this snap is: volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64adfe-3849-485a-9e72-381600881826]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:57 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b Nov 05 08:27:57 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54b57c1f-94b0-4915-b68c-acaf837c726c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8665ea88-fb4f-4c3d-9438-c701849193ec]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:27:58 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b Nov 05 08:27:58 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Flow 'volume_create_manager' (b1bd4819-50e0-43e3-8d2b-44a1099e2df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08dccff9-def9-4d70-8da3-d8307dc0fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08dccff9-def9-4d70-8da3-d8307dc0fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-751539001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327bcc21-9bc8-41df-bb75-82594a72fe9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07982cbd95fb4ac99a5b9f5ad8c7dfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:59Z,use_quota=True,user_id='2c0060997e2f4e12aaeece34e327b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d21e95-99f4-4d07-ad63-0ef26d45abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d21e95-99f4-4d07-ad63-0ef26d45abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdcbde9-6bde-45ae-962d-a4717020d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdcbde9-6bde-45ae-962d-a4717020d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327bcc21-9bc8-41df-bb75-82594a72fe9f', 'volume_name': 'volume-327bcc21-9bc8-41df-bb75-82594a72fe9f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81294516-6533-4ca2-8c5f-cad90732768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81294516-6533-4ca2-8c5f-cad90732768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bf35a6-13bd-48c7-8466-d463077a2776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Volume 327bcc21-9bc8-41df-bb75-82594a72fe9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327bcc21-9bc8-41df-bb75-82594a72fe9f', 'volume_size': 1} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-751539001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327bcc21-9bc8-41df-bb75-82594a72fe9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07982cbd95fb4ac99a5b9f5ad8c7dfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:59Z,use_quota=True,user_id='2c0060997e2f4e12aaeece34e327b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Creating volume 327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f 1073741824 Nov 05 08:27:58 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:58 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:58 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b Nov 05 08:27:58 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:27:59 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Flow 'volume_create_manager' (616506bc-2f33-4dd9-8735-d3040eea1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c46b7e8-8060-42c2-897b-0a4d4473ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c.1d527683-0412-458d-a632-61bb422e909b" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:59 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f 1073741824" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c46b7e8-8060-42c2-897b-0a4d4473ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-525206898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1bef6-f8a7-48a0-acea-6598ddcfd53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc84e006dc24f97acf5471d0d0c3fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:59Z,use_quota=True,user_id='cbebf3eb20f247e8bad98366eb6d202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e76a4b-ca9b-4e05-bc42-eece9e533636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e76a4b-ca9b-4e05-bc42-eece9e533636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2238eab0-35d4-4d7e-8eae-912935eaf301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2238eab0-35d4-4d7e-8eae-912935eaf301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c1bef6-f8a7-48a0-acea-6598ddcfd53d', 'volume_name': 'volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b787b26-a30f-4370-a9cc-cbaf67f2e646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b787b26-a30f-4370-a9cc-cbaf67f2e646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3bbbe3-6fa0-4bba-afb8-30b0ceacc014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Volume f4c1bef6-f8a7-48a0-acea-6598ddcfd53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d', 'volume_size': 1} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-1d527683-0412-458d-a632-61bb422e909b" released by "_delete_snapshot" :: held 1.795s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" released by "delete_snapshot" :: held 1.821s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:59 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f Nov 05 08:27:59 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Created reservations ['615513e3-f6fd-48ca-b44f-b262d511f76b', '2d0de66e-4ef0-43c7-833a-d13ab4e5d25e', '639d1ecc-2648-4c82-808e-fbdb72e32ded', '6e2d8d58-681e-439b-9c67-b1e0d2e4516f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:27:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Delete snapshot completed successfully. Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8408f836-a2c9-4bdb-b4e4-46d292cd65fd tempest-VolumesExtendTest-1613253806 None] Lock "cinder-1d527683-0412-458d-a632-61bb422e909b-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:27:59 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-525206898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c1bef6-f8a7-48a0-acea-6598ddcfd53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc84e006dc24f97acf5471d0d0c3fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:27:59Z,use_quota=True,user_id='cbebf3eb20f247e8bad98366eb6d202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Creating volume f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:27:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:27:59 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d 1073741824 Nov 05 08:27:59 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bf35a6-13bd-48c7-8466-d463077a2776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327bcc21-9bc8-41df-bb75-82594a72fe9f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341faf79-32d6-488a-bc64-e8e3616ab226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:27:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Volume volume-327bcc21-9bc8-41df-bb75-82594a72fe9f (327bcc21-9bc8-41df-bb75-82594a72fe9f): created successfully Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341faf79-32d6-488a-bc64-e8e3616ab226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Flow 'volume_create_manager' (b1bd4819-50e0-43e3-8d2b-44a1099e2df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:27:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-54d35499-f3cf-4916-a712-982a78fffe56 req-f79bc2a3-c944-4bd7-bae1-bbadabdad061 tempest-VolumesSnapshotsTestJSON-1677746213 None] Created volume successfully. Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-54b57c1f-94b0-4915-b68c-acaf837c726c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "cinder-54b57c1f-94b0-4915-b68c-acaf837c726c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Acquiring lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0842b-09f4-4192-9ebd-0e172957e666]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:27:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:00 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:28:00 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:00 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d 1073741824" returned: 0 in 0.603s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:00 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d Nov 05 08:28:00 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:00 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:00 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c Nov 05 08:28:00 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:00 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3bbbe3-6fa0-4bba-afb8-30b0ceacc014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5af182-2688-4f33-bd52-c51f6a096af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Volume volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d (f4c1bef6-f8a7-48a0-acea-6598ddcfd53d): created successfully Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5af182-2688-4f33-bd52-c51f6a096af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Flow 'volume_create_manager' (616506bc-2f33-4dd9-8735-d3040eea1201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c41444f-d84a-46e3-afb1-fba47cdcc9d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Created volume successfully. Nov 05 08:28:00 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54b57c1f-94b0-4915-b68c-acaf837c726c" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "cinder-quobyte-54b57c1f-94b0-4915-b68c-acaf837c726c" released by "delete_volume" :: held 0.825s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Created reservations ['5c4b2b06-b882-479a-a54f-e77b70c6223c', '73c72763-a40b-46a9-84f2-0b89143d9b3c', 'dc999b37-f336-40ca-9615-3fde9e13141f', '25f5c863-6baa-41bd-9b46-2c3f33e99c64'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:00 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:00 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Creating offline snapshot 11d98ac6-d3f6-487a-a557-c3e591a9483a of volume 327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f15cd-73ce-4514-a084-25d1362fb485]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:01 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.453s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Deleted volume successfully. Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00826459-fdb2-47bf-97b5-5948a5e496fc tempest-VolumesExtendTest-1613253806 None] Lock "cinder-54b57c1f-94b0-4915-b68c-acaf837c726c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:01 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f Nov 05 08:28:01 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:01 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:01 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a 1G Nov 05 08:28:01 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:02 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a 1G" returned: 0 in 0.493s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327bcc21-9bc8-41df-bb75-82594a72fe9f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327bcc21-9bc8-41df-bb75-82594a72fe9f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a Nov 05 08:28:02 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (8720be48-23ed-4d7b-8f9d-33d1e05d0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1b920a-78b4-4a9e-84af-7f70103f05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1b920a-78b4-4a9e-84af-7f70103f05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-723741327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9502da31-9bd4-49f5-b6ef-7e6c5be95c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:02Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866dbdb4-cbfc-4daa-87ca-6c27ca752c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866dbdb4-cbfc-4daa-87ca-6c27ca752c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f26c08-05b3-41a0-84d1-332d99bca1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f26c08-05b3-41a0-84d1-332d99bca1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9502da31-9bd4-49f5-b6ef-7e6c5be95c83', 'volume_name': 'volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fa42b2-528f-4eea-ab80-215de4c8a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fa42b2-528f-4eea-ab80-215de4c8a697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63999840-6a37-4cb5-b796-568a9f71796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Volume 9502da31-9bd4-49f5-b6ef-7e6c5be95c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83', 'volume_size': 1} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:02 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327bcc21-9bc8-41df-bb75-82594a72fe9f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a is being set with open permissions: ugo+rw Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a Nov 05 08:28:02 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:02 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a" returned: 0 in 0.260s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:02 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info Nov 05 08:28:02 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:03 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info is being set with open permissions: ugo+rw Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:03 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info Nov 05 08:28:03 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:03 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.info" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.827s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Creating offline snapshot ab07b5e1-9c59-4763-93f0-a1ddcd69d353 of volume f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:28:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-1d23c096-a880-4774-8241-3fc41c34b7d2 req-b16ac2b2-6081-4d05-99ae-4e11aa90a0d5 tempest-VolumesSnapshotsTestJSON-1677746213 None] Create snapshot completed successfully Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cab813-b0cd-4a0d-a223-f5183f391d1c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:03 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d Nov 05 08:28:03 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "cinder-11d98ac6-d3f6-487a-a557-c3e591a9483a-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:03 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-11d98ac6-d3f6-487a-a557-c3e591a9483a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:04 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 1G Nov 05 08:28:04 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "cinder-quobyte-11d98ac6-d3f6-487a-a557-c3e591a9483a" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-11d98ac6-d3f6-487a-a557-c3e591a9483a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Deleting offline snapshot 11d98ac6-d3f6-487a-a557-c3e591a9483a of volume 327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] snapshot_file for this snap is: volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6193ab8-d171-4eeb-baf7-074e13b12ae7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a Nov 05 08:28:04 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 1G" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 Nov 05 08:28:04 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327bcc21-9bc8-41df-bb75-82594a72fe9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e12d2-2351-4def-8743-a2cc8f4571ed]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f Nov 05 08:28:04 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:04 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:04 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 is being set with open permissions: ugo+rw Nov 05 08:28:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:04 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 Nov 05 08:28:04 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f" returned: 0 in 0.475s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a Nov 05 08:28:05 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info Nov 05 08:28:05 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info is being set with open permissions: ugo+rw Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a Nov 05 08:28:05 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info Nov 05 08:28:05 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f.11d98ac6-d3f6-487a-a557-c3e591a9483a" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.info" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.265s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-723741327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9502da31-9bd4-49f5-b6ef-7e6c5be95c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1766cd97de40d1a4ae22dcd7e0a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:02Z,use_quota=True,user_id='e4eac8e5f06f465b9631e34a758b501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Creating volume 9502da31-9bd4-49f5-b6ef-7e6c5be95c83 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:05 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 1073741824 Nov 05 08:28:05 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-11d98ac6-d3f6-487a-a557-c3e591a9483a" released by "_delete_snapshot" :: held 1.897s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b28278d6-881c-45a1-bce2-ed1f8b399ce0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Create snapshot completed successfully Nov 05 08:28:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" released by "delete_snapshot" :: held 1.927s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.quota [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Created reservations ['c6d30d05-6481-4cbc-a591-78c5c8fffb08', 'f8c76d5e-1cfa-4472-a60e-d60d81649ec0', '3d39248c-6a51-4e06-a08f-a49729830242', 'a9261def-321b-47b9-815b-0b9395902c8d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Delete snapshot completed successfully. Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-afdb5107-268b-4aee-b201-f039f12843bd req-eb133bdd-1d9e-4501-a283-0c57aa769eec tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-11d98ac6-d3f6-487a-a557-c3e591a9483a-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "cinder-327bcc21-9bc8-41df-bb75-82594a72fe9f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-327bcc21-9bc8-41df-bb75-82594a72fe9f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:06 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 1073741824" returned: 0 in 0.546s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[94937ffb-4cf0-48d9-b708-f7ef471fd1f7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:06 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 Nov 05 08:28:06 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:06 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f Nov 05 08:28:06 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:06 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63999840-6a37-4cb5-b796-568a9f71796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a445a55-b9a1-4555-8e59-47f06a8b577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Volume volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 (9502da31-9bd4-49f5-b6ef-7e6c5be95c83): created successfully Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a445a55-b9a1-4555-8e59-47f06a8b577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Flow 'volume_create_manager' (8720be48-23ed-4d7b-8f9d-33d1e05d0d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a2c8b94e-7a00-4b31-bf55-37e869056459 tempest-AttachVolumeNegativeTest-88548250 None] Created volume successfully. Nov 05 08:28:06 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:06 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f Nov 05 08:28:06 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:07 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-327bcc21-9bc8-41df-bb75-82594a72fe9f" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-quobyte-327bcc21-9bc8-41df-bb75-82594a72fe9f" released by "delete_volume" :: held 0.814s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.quota [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Created reservations ['febd64dd-56fc-4b6b-8db7-eba7533b327a', '273833ab-b758-49bc-9cdb-c3571c0a8ec4', '2042073c-5514-496d-8adf-7a016c053caf', 'b721c912-c31b-466d-8cb6-912645e77333'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:07 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:07 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "cinder-ab07b5e1-9c59-4763-93f0-a1ddcd69d353-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-ab07b5e1-9c59-4763-93f0-a1ddcd69d353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "cinder-quobyte-ab07b5e1-9c59-4763-93f0-a1ddcd69d353" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-ab07b5e1-9c59-4763-93f0-a1ddcd69d353" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Deleting offline snapshot ab07b5e1-9c59-4763-93f0-a1ddcd69d353 of volume f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] snapshot_file for this snap is: volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff78181c-e015-4a14-8840-fa60e8cc9723]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:07 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.manager [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Deleted volume successfully. Nov 05 08:28:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-2ab247f7-6da1-4349-a2bb-cdb851a06410 req-4ebb55f2-fb63-4748-aee9-b143e67bdf86 tempest-VolumesSnapshotsTestJSON-1677746213 None] Lock "cinder-327bcc21-9bc8-41df-bb75-82594a72fe9f-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:07 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 Nov 05 08:28:07 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:08 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353" returned: 0 in 0.539s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0542d5-c61c-4fa4-b253-76a5adec9230]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:08 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d Nov 05 08:28:08 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:08 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:08 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 Nov 05 08:28:08 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:09 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353" returned: 0 in 0.529s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:09 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353 Nov 05 08:28:09 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f6767906-4581-4d64-ab08-dd77778648be req-840db2c8-4a4e-4091-83cf-05252cc502e1 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f6767906-4581-4d64-ab08-dd77778648be req-840db2c8-4a4e-4091-83cf-05252cc502e1 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f6767906-4581-4d64-ab08-dd77778648be req-840db2c8-4a4e-4091-83cf-05252cc502e1 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f6767906-4581-4d64-ab08-dd77778648be req-840db2c8-4a4e-4091-83cf-05252cc502e1 tempest-AttachVolumeNegativeTest-88548250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4436018f-6c10-40f7-ba18-8a8e30b2c9e8', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:28:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f6767906-4581-4d64-ab08-dd77778648be req-840db2c8-4a4e-4091-83cf-05252cc502e1 tempest-AttachVolumeNegativeTest-88548250 None] attachment_update completed successfully. Nov 05 08:28:09 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d.ab07b5e1-9c59-4763-93f0-a1ddcd69d353" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-ab07b5e1-9c59-4763-93f0-a1ddcd69d353" released by "_delete_snapshot" :: held 1.992s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" released by "delete_snapshot" :: held 2.042s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Created reservations ['e04ff9d1-c2e8-4891-b946-9cb9c55fb4b7', 'd97ec13a-1799-4eca-9199-70e9fe48a9c5', '084308d4-a237-4b9a-b96a-c6268ec96ee3', '47cec005-9a11-4900-b4be-4058568b070e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Delete snapshot completed successfully. Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60b060c9-ec78-44f8-8848-0da6272e856f tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-ab07b5e1-9c59-4763-93f0-a1ddcd69d353-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Flow 'volume_create_manager' (8c1ee519-99eb-4c12-a0ff-b7c176c6579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff1951a-772b-4ec9-becb-7fde350ed3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff1951a-772b-4ec9-becb-7fde350ed3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-736395017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f9d95-e137-445f-a379-48e8c1611bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b156b359223400bb92fa310773cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:10Z,use_quota=True,user_id='089caad050c04601bd9621ff9837901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cddea0b-bcc8-4d17-94d9-aee58d98064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cddea0b-bcc8-4d17-94d9-aee58d98064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0efb27-9fab-4803-89ac-3745ee390c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0efb27-9fab-4803-89ac-3745ee390c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241f9d95-e137-445f-a379-48e8c1611bf2', 'volume_name': 'volume-241f9d95-e137-445f-a379-48e8c1611bf2', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932b7102-dab9-40f3-a652-c3e61c33002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932b7102-dab9-40f3-a652-c3e61c33002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc1487e-0b0a-4da7-88ca-20b689c00e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Volume 241f9d95-e137-445f-a379-48e8c1611bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241f9d95-e137-445f-a379-48e8c1611bf2', 'volume_size': 2} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-736395017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f9d95-e137-445f-a379-48e8c1611bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b156b359223400bb92fa310773cafb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:10Z,use_quota=True,user_id='089caad050c04601bd9621ff9837901a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Creating volume 241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 2147483648 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 2147483648 Nov 05 08:28:10 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "cinder-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec1d99-7b58-4469-a81b-c6c67608def8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d Nov 05 08:28:10 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 2147483648" returned: 0 in 0.810s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:10 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d Nov 05 08:28:10 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:10 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 Nov 05 08:28:10 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:11 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-quobyte-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d" released by "delete_volume" :: held 0.937s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:11 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc1487e-0b0a-4da7-88ca-20b689c00e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241f9d95-e137-445f-a379-48e8c1611bf2', 'volume_size': 2}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d522ab-5c25-471f-a78e-c849dd4f605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Volume volume-241f9d95-e137-445f-a379-48e8c1611bf2 (241f9d95-e137-445f-a379-48e8c1611bf2): created successfully Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d522ab-5c25-471f-a78e-c849dd4f605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Flow 'volume_create_manager' (8c1ee519-99eb-4c12-a0ff-b7c176c6579a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d4ea492-1710-4ffd-ad17-5e9a7289cfcd tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Created volume successfully. Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Created reservations ['91390b53-66b6-4860-b9b8-05da0b451897', '1e4592c7-0247-4e3f-9d23-3f527889205c', '3d5155fd-660e-489e-8e64-03fece769f95', '0843264a-1832-4da7-9804-e0d49dbd77fc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:11 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:11 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:11 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Deleted volume successfully. Nov 05 08:28:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-83bccf44-9cb4-45fa-ad3d-5da9d5c6e3fc tempest-VolumeSnapshotQuotasNegativeTestJSON-1305767346 None] Lock "cinder-f4c1bef6-f8a7-48a0-acea-6598ddcfd53d-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Creating offline snapshot 33eb0548-c108-4415-852a-d199656c1da4 of volume 241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:28:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-0d4391d7-d1cc-48cc-82f8-4853a43cee97 req-f0ba08ae-4961-41c6-83a6-be949857d3ca tempest-AttachVolumeNegativeTest-88548250 None] Terminate volume connection completed successfully. Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-0d4391d7-d1cc-48cc-82f8-4853a43cee97 req-f0ba08ae-4961-41c6-83a6-be949857d3ca tempest-AttachVolumeNegativeTest-88548250 None] Deleting attachment 4436018f-6c10-40f7-ba18-8a8e30b2c9e8. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead6ef6-6ae4-4862-9c78-f735f08d1590]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:12 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 Nov 05 08:28:12 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:12 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2" returned: 0 in 0.479s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 2G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:12 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 2G Nov 05 08:28:12 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:13 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 2G" returned: 0 in 0.699s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241f9d95-e137-445f-a379-48e8c1611bf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:13 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241f9d95-e137-445f-a379-48e8c1611bf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 Nov 05 08:28:13 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:13 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241f9d95-e137-445f-a379-48e8c1611bf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4" returned: 0 in 0.547s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:13 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 is being set with open permissions: ugo+rw Nov 05 08:28:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:13 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 Nov 05 08:28:13 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:14 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4" returned: 0 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:14 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info Nov 05 08:28:14 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:14 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info is being set with open permissions: ugo+rw Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:14 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info Nov 05 08:28:14 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:14 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.info" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d46fc353-2d38-4fe6-9086-f8a8e45b7b04 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Create snapshot completed successfully Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "cinder-33eb0548-c108-4415-852a-d199656c1da4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-33eb0548-c108-4415-852a-d199656c1da4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "cinder-quobyte-33eb0548-c108-4415-852a-d199656c1da4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-33eb0548-c108-4415-852a-d199656c1da4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Deleting offline snapshot 33eb0548-c108-4415-852a-d199656c1da4 of volume 241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] snapshot_file for this snap is: volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[70375b16-1850-43a4-8370-56a6383129fc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:15 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 Nov 05 08:28:15 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:16 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4" returned: 0 in 0.681s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241f9d95-e137-445f-a379-48e8c1611bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f60dd2-b277-4950-b1f1-a9b12da04201]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:16 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 Nov 05 08:28:16 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:16 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2" returned: 0 in 0.498s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:16 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 Nov 05 08:28:16 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:17 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4" returned: 0 in 0.465s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:17 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4 Nov 05 08:28:17 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:17 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2.33eb0548-c108-4415-852a-d199656c1da4" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-33eb0548-c108-4415-852a-d199656c1da4" released by "_delete_snapshot" :: held 2.166s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" released by "delete_snapshot" :: held 2.195s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Created reservations ['fd6dea9a-c5ac-430e-89a8-dd7823d8de48', '0e057993-ec33-44a8-985b-67f65f2b44ae', '57afb888-c2f4-4973-9c13-8a4fd57a3cc2', '6bf85d72-edc7-4712-971a-4028a2b3d7ce'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Delete snapshot completed successfully. Nov 05 08:28:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4dadb536-c8a2-46cb-90fa-d5b28475c074 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-33eb0548-c108-4415-852a-d199656c1da4-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-9502da31-9bd4-49f5-b6ef-7e6c5be95c83-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-9502da31-9bd4-49f5-b6ef-7e6c5be95c83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-quobyte-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af856c7-1c48-41be-ae0c-b0311c558f72]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:18 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:18 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:18 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 Nov 05 08:28:18 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:18 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:28:18 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" returned: 0 in 0.443s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:18 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83 Nov 05 08:28:18 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "cinder-241f9d95-e137-445f-a379-48e8c1611bf2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-241f9d95-e137-445f-a379-48e8c1611bf2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" acquired by "delete_volume" :: waited 0.044s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d875b9-2ae4-4d77-b158-8f3ed9abb2be]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:19 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" returned: 0 in 0.407s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-9502da31-9bd4-49f5-b6ef-7e6c5be95c83" released by "delete_volume" :: held 0.928s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:19 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 Nov 05 08:28:19 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Created reservations ['ef312666-aad1-4788-95ba-6af38c7b1006', '72d3d229-2d88-4e34-ace5-31e79e63e90e', 'd6503f38-9ca4-4e81-a5f8-211ad3a96e06', 'ccaf28be-c245-46dc-ac08-faaf84fab3f7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:19 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:19 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:19 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:19 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2 Nov 05 08:28:19 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1b92615-8a9c-4c4c-b5d6-d56007676a68 tempest-GroupsTest-1792213258 None] Group tempest-Group1-338209825: creating Nov 05 08:28:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1b92615-8a9c-4c4c-b5d6-d56007676a68 tempest-GroupsTest-1792213258 None] Group tempest-Group1-338209825: created successfully Nov 05 08:28:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1b92615-8a9c-4c4c-b5d6-d56007676a68 tempest-GroupsTest-1792213258 None] Create group completed successfully. Nov 05 08:28:19 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Deleted volume successfully. Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff8c1c95-d7d0-4b05-b068-56ed24b765ef tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-9502da31-9bd4-49f5-b6ef-7e6c5be95c83-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:19 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-241f9d95-e137-445f-a379-48e8c1611bf2" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-quobyte-241f9d95-e137-445f-a379-48e8c1611bf2" released by "delete_volume" :: held 0.867s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Created reservations ['eceeee0b-f62e-47fc-804f-3caca11c04c7', '7f786ac3-937c-4e98-b08a-4ba87ba61159', '148352d2-20f3-488b-9a31-beeed5000025', '5a1b9784-64bb-463e-a48c-21c8a7c25444'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:19 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:19 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:20 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Deleted volume successfully. Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef8f7d14-f30a-4467-9eb4-8e6c895686c1 tempest-VolumesSnapshotNegativeTestJSON-276264944 None] Lock "cinder-241f9d95-e137-445f-a379-48e8c1611bf2-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-915b571e-1a72-4e26-9afe-5ceec0db5f21-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-915b571e-1a72-4e26-9afe-5ceec0db5f21-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-quobyte-915b571e-1a72-4e26-9afe-5ceec0db5f21" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-915b571e-1a72-4e26-9afe-5ceec0db5f21" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[691559e4-c605-4c08-bbe5-0762951a786e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:20 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 Nov 05 08:28:20 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Flow 'volume_create_manager' (2d3e9f3e-9d27-4147-bd9c-07f763376a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cda6393-13ed-41e3-b540-2854ca5b6b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cda6393-13ed-41e3-b540-2854ca5b6b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1824182828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66824320-5ac7-4578-a13e-ff02c6a38ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb981303ae643c3917249a972cb035b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:21Z,use_quota=True,user_id='443d165946084792ad9d4896229cc4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f90ee4-48e6-4c13-aa7f-8209fb7a5e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f90ee4-48e6-4c13-aa7f-8209fb7a5e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e588be-cab7-4a77-90cb-c47e5fbb7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:20 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:28:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45f31ee7-8389-40ef-b30d-c38d45b2949d tempest-GroupsTest-1792213258 None] Group tempest-Group2-1826562877: creating Nov 05 08:28:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45f31ee7-8389-40ef-b30d-c38d45b2949d tempest-GroupsTest-1792213258 None] Group tempest-Group2-1826562877: created successfully Nov 05 08:28:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45f31ee7-8389-40ef-b30d-c38d45b2949d tempest-GroupsTest-1792213258 None] Create group completed successfully. Nov 05 08:28:21 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:21 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21 Nov 05 08:28:21 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e588be-cab7-4a77-90cb-c47e5fbb7d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66824320-5ac7-4578-a13e-ff02c6a38ffe', 'volume_name': 'volume-66824320-5ac7-4578-a13e-ff02c6a38ffe', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb890af-ad07-4b7c-ba38-b10ecd078d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb890af-ad07-4b7c-ba38-b10ecd078d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7d1c27-e355-461c-aff6-35ef1e0ac8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Volume 66824320-5ac7-4578-a13e-ff02c6a38ffe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66824320-5ac7-4578-a13e-ff02c6a38ffe', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Trying to clone 66824320-5ac7-4578-a13e-ff02c6a38ffe from image 9dbb82da-9633-4e04-9ee8-18373a09d135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:28:21 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-915b571e-1a72-4e26-9afe-5ceec0db5f21" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-915b571e-1a72-4e26-9afe-5ceec0db5f21" released by "delete_volume" :: held 0.802s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=145,cinder:INSERT=36,cinder:UPDATE=150,cinder:DELETE=15 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Created reservations ['c6a1662d-3687-4cc0-a019-07e9835d85f2', 'c3dafeb3-9d85-4616-b786-739bd21aa4c7', '4cd53117-d0e6-4ee8-81d8-3e9e203e7ac4', '4db5b2cf-ac56-42f2-8429-575674a4216b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:21 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:21 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:28:21 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a043f55-2e2d-45aa-94da-89fdbe6b70ac]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-4a114b4f-1219-4f83-a134-d69ed81ccd72-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:22 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD Nov 05 08:28:22 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-4a114b4f-1219-4f83-a134-d69ed81ccd72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:22 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Deleted volume successfully. Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "cinder-quobyte-4a114b4f-1219-4f83-a134-d69ed81ccd72" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-045d5c43-e9c1-4212-bdd7-89d298e62e1f tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-915b571e-1a72-4e26-9afe-5ceec0db5f21-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-4a114b4f-1219-4f83-a134-d69ed81ccd72" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3ba01-9463-4309-946f-456469e64ff7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 Nov 05 08:28:22 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 is fetched for user 443d165946084792ad9d4896229cc4fb. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[54130f88-170f-43c5-8fbe-29a9ead1f0f4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD Nov 05 08:28:22 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (2e0eabcf-9d63-43d8-9401-622f859dc735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e5e4c3-5efa-4341-8a72-1796d685d131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e5e4c3-5efa-4341-8a72-1796d685d131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103701454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff66fecb-43cd-462e-9d70-3a95738014d7,host='devstack@QuobyteHD#QuobyteHD',id=747e298a-9df0-4db2-ad85-e9625c7bd02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:23Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519c2a12-3ef5-4a06-a987-285f44a21f70),volume_type_id=519c2a12-3ef5-4a06-a987-285f44a21f70)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f71974-a5c6-491a-9285-4d0a14481883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f71974-a5c6-491a-9285-4d0a14481883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:22 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaf107c-f4a6-4390-bd5d-63394f774244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaf107c-f4a6-4390-bd5d-63394f774244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747e298a-9df0-4db2-ad85-e9625c7bd02b', 'volume_name': 'volume-747e298a-9df0-4db2-ad85-e9625c7bd02b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ea85a-c0f9-4e3d-b9f9-bf06cfc05cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ea85a-c0f9-4e3d-b9f9-bf06cfc05cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595f18a-b075-4e6d-b214-43822a3c96c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Volume 747e298a-9df0-4db2-ad85-e9625c7bd02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747e298a-9df0-4db2-ad85-e9625c7bd02b', 'volume_size': 1} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff66fecb-43cd-462e-9d70-3a95738014d7,created_at=2026-11-05T07:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103701454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff66fecb-43cd-462e-9d70-3a95738014d7,host='devstack@QuobyteHD#QuobyteHD',id=747e298a-9df0-4db2-ad85-e9625c7bd02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:23Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(519c2a12-3ef5-4a06-a987-285f44a21f70),volume_type_id=519c2a12-3ef5-4a06-a987-285f44a21f70)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Creating volume 747e298a-9df0-4db2-ad85-e9625c7bd02b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72" returned: 0 in 0.664s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:22 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b 1073741824 Nov 05 08:28:22 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72 Nov 05 08:28:22 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:22 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:23 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4a114b4f-1219-4f83-a134-d69ed81ccd72" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-quobyte-4a114b4f-1219-4f83-a134-d69ed81ccd72" released by "delete_volume" :: held 1.012s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Created reservations ['c5e0ee41-c3f0-4285-ac58-7b2893f5975d', 'd8710f8a-d231-4293-a2c1-429b401bdec6', '4baa4ed3-8efc-4e9b-81dc-459b39106d14', '9d22a4cc-e672-4510-9274-a85b148c0079'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:23 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:23 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:23 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b 1073741824" returned: 0 in 0.560s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:23 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b Nov 05 08:28:23 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:23 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Deleted volume successfully. Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0dff19ef-31e0-4a3a-8119-7be00035d872 tempest-AttachVolumeNegativeTest-88548250 None] Lock "cinder-4a114b4f-1219-4f83-a134-d69ed81ccd72-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:23 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1824182828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66824320-5ac7-4578-a13e-ff02c6a38ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb981303ae643c3917249a972cb035b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:21Z,use_quota=True,user_id='443d165946084792ad9d4896229cc4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Creating volume 66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:23 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1073741824 Nov 05 08:28:23 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595f18a-b075-4e6d-b214-43822a3c96c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747e298a-9df0-4db2-ad85-e9625c7bd02b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c578180-3431-47e0-8a20-1bd9bb419f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Volume volume-747e298a-9df0-4db2-ad85-e9625c7bd02b (747e298a-9df0-4db2-ad85-e9625c7bd02b): created successfully Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c578180-3431-47e0-8a20-1bd9bb419f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (2e0eabcf-9d63-43d8-9401-622f859dc735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-471c6b53-4c71-4461-82b4-942423326c99 tempest-GroupsTest-1792213258 None] Created volume successfully. Nov 05 08:28:24 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1073741824" returned: 0 in 0.559s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:24 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe Nov 05 08:28:24 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:24 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Attempting download of 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 66824320-5ac7-4578-a13e-ff02c6a38ffe. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b97d595-7105-456b-907d-69b8a1bc3368]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:24 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s Nov 05 08:28:24 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Acquiring lock "cinder-quobyte-747e298a-9df0-4db2-ad85-e9625c7bd02b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-747e298a-9df0-4db2-ad85-e9625c7bd02b" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae4db83-2c6a-4bc9-aba7-051768b4b72b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b Nov 05 08:28:25 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s Nov 05 08:28:25 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b" returned: 0 in 0.457s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b Nov 05 08:28:25 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s" returned: 1 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135_hx3cl97s' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[344306ba-8e2a-42cb-97f2-34199c3cdb2c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:25 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD Nov 05 08:28:25 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:25 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-747e298a-9df0-4db2-ad85-e9625c7bd02b" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-747e298a-9df0-4db2-ad85-e9625c7bd02b" released by "delete_volume" :: held 0.808s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:25 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Created reservations ['666c3379-2f10-4550-af6d-2968e542450a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:25 devstack cinder-volume[87092]: WARNING cinder.quota [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1537664244 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1537664244, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:28:25 devstack cinder-volume[87092]: WARNING cinder.quota [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1537664244 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1537664244, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:28:26 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] 9dbb82da-9633-4e04-9ee8-18373a09d135 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Created reservations ['d9baaeb0-b62a-4cad-bdc7-38e368ee3951', 'd7ee2378-a893-4b01-9465-788b365499d0', '40a70a6e-bf21-458a-8e8f-0585feb29398', 'b7e9fbea-efc2-47ef-991d-28be87d162b7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:26 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe Nov 05 08:28:26 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:26 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:26 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Created reservations ['c1008ae7-f1e7-4fa6-94dc-d7a56a5b259e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:26 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e4fa7a59-d236-4efd-aa2d-c675be1a917e tempest-GroupsTest-1792213258 None] Delete group completed successfully. Nov 05 08:28:26 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:26 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:26 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eeab8568-d174-42a1-99bd-5c4631c8c296 tempest-GroupsTest-1792213258 None] Delete group completed successfully. Nov 05 08:28:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-025ae75c-4ed0-4c70-82b2-5af629428794 tempest-GroupsTest-1792213258 None] Group tempest-GroupsTest-Group-347453441: creating Nov 05 08:28:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-025ae75c-4ed0-4c70-82b2-5af629428794 tempest-GroupsTest-1792213258 None] Group tempest-GroupsTest-Group-347453441: created successfully Nov 05 08:28:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-025ae75c-4ed0-4c70-82b2-5af629428794 tempest-GroupsTest-1792213258 None] Create group completed successfully. Nov 05 08:28:28 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe" returned: 0 in 2.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:28 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_gv_kj_rtdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:28:28 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Converted 112.00 MB image at 45.59 MB/s Nov 05 08:28:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:28 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1G Nov 05 08:28:28 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:28 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe 1G" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Downloaded image 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 66824320-5ac7-4578-a13e-ff02c6a38ffe successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 for user 443d165946084792ad9d4896229cc4fb is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Marking volume 66824320-5ac7-4578-a13e-ff02c6a38ffe as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Copying metadata from image 9dbb82da-9633-4e04-9ee8-18373a09d135 to 66824320-5ac7-4578-a13e-ff02c6a38ffe. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Creating volume glance metadata for volume 66824320-5ac7-4578-a13e-ff02c6a38ffe backed by image 9dbb82da-9633-4e04-9ee8-18373a09d135 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7d1c27-e355-461c-aff6-35ef1e0ac8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66824320-5ac7-4578-a13e-ff02c6a38ffe', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c897cf1-5765-4a77-9695-ad1f3b237448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Volume volume-66824320-5ac7-4578-a13e-ff02c6a38ffe (66824320-5ac7-4578-a13e-ff02c6a38ffe): created successfully Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c897cf1-5765-4a77-9695-ad1f3b237448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Flow 'volume_create_manager' (2d3e9f3e-9d27-4147-bd9c-07f763376a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9706655d-0126-4eb3-8f80-4d782609c985 tempest-VolumesImageMetadata-2059940912 None] Created volume successfully. Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (0087c692-a82c-4b1e-b95c-8ab1aa737284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eab858-4cbb-4e96-8623-640b78fe9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eab858-4cbb-4e96-8623-640b78fe9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87889136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7e56cb-68ca-4822-8611-c492dca81f10,host='devstack@QuobyteHD#QuobyteHD',id=e396a3c0-92a6-4ec9-b346-cd09193a41a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:30Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(816ae5bd-78d8-4972-b986-e2ae5a78b2ff),volume_type_id=816ae5bd-78d8-4972-b986-e2ae5a78b2ff)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470638f3-b810-433c-86a4-acd44b3b61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470638f3-b810-433c-86a4-acd44b3b61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088a70f5-b5ff-43bd-8bad-a8e1dc1b312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088a70f5-b5ff-43bd-8bad-a8e1dc1b312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e396a3c0-92a6-4ec9-b346-cd09193a41a2', 'volume_name': 'volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386a344-d7e1-446a-a971-b9a51d144c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b386a344-d7e1-446a-a971-b9a51d144c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ce671-3174-476a-a4b5-d88dd8723ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:30 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Volume e396a3c0-92a6-4ec9-b346-cd09193a41a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2', 'volume_size': 1} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f7e56cb-68ca-4822-8611-c492dca81f10,created_at=2026-11-05T07:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-87889136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7e56cb-68ca-4822-8611-c492dca81f10,host='devstack@QuobyteHD#QuobyteHD',id=e396a3c0-92a6-4ec9-b346-cd09193a41a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:30Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(816ae5bd-78d8-4972-b986-e2ae5a78b2ff),volume_type_id=816ae5bd-78d8-4972-b986-e2ae5a78b2ff)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Creating volume e396a3c0-92a6-4ec9-b346-cd09193a41a2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:30 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:30 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 1073741824 Nov 05 08:28:30 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Acquiring lock "cinder-66824320-5ac7-4578-a13e-ff02c6a38ffe-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "cinder-66824320-5ac7-4578-a13e-ff02c6a38ffe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Acquiring lock "cinder-quobyte-66824320-5ac7-4578-a13e-ff02c6a38ffe" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "cinder-quobyte-66824320-5ac7-4578-a13e-ff02c6a38ffe" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1c99f-4d46-435d-8ebc-3789ba145d6a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:30 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe Nov 05 08:28:30 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:30 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 1073741824" returned: 0 in 0.679s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:31 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 Nov 05 08:28:31 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:31 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe" returned: 0 in 0.480s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:31 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe Nov 05 08:28:31 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:31 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ce671-3174-476a-a4b5-d88dd8723ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44de7620-3598-469d-8956-3bd179910b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:31 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Volume volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 (e396a3c0-92a6-4ec9-b346-cd09193a41a2): created successfully Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44de7620-3598-469d-8956-3bd179910b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (0087c692-a82c-4b1e-b95c-8ab1aa737284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-beeddc84-6844-4378-a25b-60a2795100ef tempest-GroupsTest-1792213258 None] Created volume successfully. Nov 05 08:28:31 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-66824320-5ac7-4578-a13e-ff02c6a38ffe" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "cinder-quobyte-66824320-5ac7-4578-a13e-ff02c6a38ffe" released by "delete_volume" :: held 0.914s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Created reservations ['6a23fe61-b794-466b-8d02-e9829e200426', '5c26098c-5c54-4d8e-a89f-afe63622309c', '8eee5ecd-0236-44bd-9db9-5d3bf3fd54d1', 'fcf99ef8-0172-429a-8c87-dfd81f7bbb45'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:31 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:31 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:31 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Deleted volume successfully. Nov 05 08:28:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8ad2be3-d756-4448-8bf1-869a54d32ee3 tempest-VolumesImageMetadata-2059940912 None] Lock "cinder-66824320-5ac7-4578-a13e-ff02c6a38ffe-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (2a5c6184-002f-4157-a2e0-d267ec93ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e0d163-f4e9-48ad-b4f5-6b1be6e02388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e0d163-f4e9-48ad-b4f5-6b1be6e02388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-725001279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7e56cb-68ca-4822-8611-c492dca81f10,host='devstack@QuobyteHD#QuobyteHD',id=83a1d2bb-196f-4e82-8b0c-b758558155f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:34Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(816ae5bd-78d8-4972-b986-e2ae5a78b2ff),volume_type_id=816ae5bd-78d8-4972-b986-e2ae5a78b2ff)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866e4685-ce5d-47c7-9b56-a4b7d154ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866e4685-ce5d-47c7-9b56-a4b7d154ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab11dba3-0ae8-4069-a491-27a6c934a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab11dba3-0ae8-4069-a491-27a6c934a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a1d2bb-196f-4e82-8b0c-b758558155f7', 'volume_name': 'volume-83a1d2bb-196f-4e82-8b0c-b758558155f7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec1d2f-88c6-446a-a4dd-53310a960cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ec1d2f-88c6-446a-a4dd-53310a960cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae65da12-99b3-4431-8d2b-a8c0b0640dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Volume 83a1d2bb-196f-4e82-8b0c-b758558155f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a1d2bb-196f-4e82-8b0c-b758558155f7', 'volume_size': 1} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f7e56cb-68ca-4822-8611-c492dca81f10,created_at=2026-11-05T07:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-725001279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7e56cb-68ca-4822-8611-c492dca81f10,host='devstack@QuobyteHD#QuobyteHD',id=83a1d2bb-196f-4e82-8b0c-b758558155f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db45289832848dea659e9fead495065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:34Z,use_quota=True,user_id='e8cc9d2f148442d2a8c615f7744f5652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(816ae5bd-78d8-4972-b986-e2ae5a78b2ff),volume_type_id=816ae5bd-78d8-4972-b986-e2ae5a78b2ff)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Creating volume 83a1d2bb-196f-4e82-8b0c-b758558155f7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:33 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:33 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 1073741824 Nov 05 08:28:33 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:34 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 1073741824" returned: 0 in 0.614s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:34 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 Nov 05 08:28:34 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:34 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae65da12-99b3-4431-8d2b-a8c0b0640dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a1d2bb-196f-4e82-8b0c-b758558155f7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:34 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe64432e-2769-442c-a26c-5694bd731e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Volume volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 (83a1d2bb-196f-4e82-8b0c-b758558155f7): created successfully Nov 05 08:28:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe64432e-2769-442c-a26c-5694bd731e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Flow 'volume_create_manager' (2a5c6184-002f-4157-a2e0-d267ec93ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3dfbe5f4-77c9-4c0a-87a0-12c7b2ad1616 tempest-GroupsTest-1792213258 None] Created volume successfully. Nov 05 08:28:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2e10999c-123f-4f32-bfc7-e848d76a49a6 tempest-GroupsTest-1792213258 None] Update group completed successfully. Nov 05 08:28:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1abcd000-b293-4529-9e7c-fc87d9a06d11 tempest-GroupsTest-1792213258 None] Update group completed successfully. Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Flow 'volume_create_manager' (142167df-81a5-42c8-b9d3-f9e9df05af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7febb8-4484-4d61-8a79-0c6acd3985e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7febb8-4484-4d61-8a79-0c6acd3985e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1275509284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa983c34-77cc-49f8-88fb-2aa3a838b11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3530b844ed2a47c397a7f6cac46d0bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:39Z,use_quota=True,user_id='0c02c2bd8d8e478f9239abb3784fccf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72a62cc-9667-46b6-84ab-4139c646f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72a62cc-9667-46b6-84ab-4139c646f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d990085b-43fd-4b00-8e7d-9a8df9653736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d990085b-43fd-4b00-8e7d-9a8df9653736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa983c34-77cc-49f8-88fb-2aa3a838b11d', 'volume_name': 'volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8078d162-a284-42a8-9329-43439fb6e70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8078d162-a284-42a8-9329-43439fb6e70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee80507d-8988-43af-96a1-2fee1722d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Volume aa983c34-77cc-49f8-88fb-2aa3a838b11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d', 'volume_size': 1} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1275509284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa983c34-77cc-49f8-88fb-2aa3a838b11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3530b844ed2a47c397a7f6cac46d0bc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:39Z,use_quota=True,user_id='0c02c2bd8d8e478f9239abb3784fccf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Creating volume aa983c34-77cc-49f8-88fb-2aa3a838b11d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:38 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d 1073741824 Nov 05 08:28:38 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:39 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d 1073741824" returned: 0 in 0.693s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:39 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d Nov 05 08:28:39 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:39 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Acquiring lock "cinder-quobyte-83a1d2bb-196f-4e82-8b0c-b758558155f7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee80507d-8988-43af-96a1-2fee1722d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb07eca-d1a7-4b28-9257-8c0fde7755f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Volume volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d (aa983c34-77cc-49f8-88fb-2aa3a838b11d): created successfully Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb07eca-d1a7-4b28-9257-8c0fde7755f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Flow 'volume_create_manager' (142167df-81a5-42c8-b9d3-f9e9df05af7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-83a1d2bb-196f-4e82-8b0c-b758558155f7" acquired by "delete_volume" :: waited 0.067s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7c20905d-b2a1-4c10-9726-2c9c99ede6cf tempest-AbsoluteLimitsTests-569960958 None] Created volume successfully. Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ada19e-a945-47bf-b81c-26a3cdcff783]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:40 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 Nov 05 08:28:40 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:40 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:40 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7 Nov 05 08:28:40 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:40 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-83a1d2bb-196f-4e82-8b0c-b758558155f7" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-83a1d2bb-196f-4e82-8b0c-b758558155f7" released by "delete_volume" :: held 0.789s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Acquiring lock "cinder-quobyte-e396a3c0-92a6-4ec9-b346-cd09193a41a2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-e396a3c0-92a6-4ec9-b346-cd09193a41a2" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fbb53a-48e5-47e6-a5d4-5b3abb71b57e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:41 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 Nov 05 08:28:41 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:41 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2" returned: 0 in 0.465s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:41 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2 Nov 05 08:28:41 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Acquiring lock "cinder-aa983c34-77cc-49f8-88fb-2aa3a838b11d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "cinder-aa983c34-77cc-49f8-88fb-2aa3a838b11d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Acquiring lock "cinder-quobyte-aa983c34-77cc-49f8-88fb-2aa3a838b11d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "cinder-quobyte-aa983c34-77cc-49f8-88fb-2aa3a838b11d" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[60af3413-5388-48f6-90cd-fcec927c2a93]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:41 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e396a3c0-92a6-4ec9-b346-cd09193a41a2" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "cinder-quobyte-e396a3c0-92a6-4ec9-b346-cd09193a41a2" released by "delete_volume" :: held 0.859s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:41 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d Nov 05 08:28:41 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Created reservations ['2c0e6f49-c5fd-4e83-8f86-3c92d6cad2e1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1352554121 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1352554121, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:28:41 devstack cinder-volume[87092]: WARNING cinder.quota [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1352554121 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1352554121, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:28:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Created reservations ['1172e71a-302b-4a12-8f0b-5789496120f3', 'b1c792fd-6b9b-43b6-9aa8-52351854bcb4', '384571f4-0c16-40d3-808f-cf4599099ae1', 'e1c159c0-1207-4124-b1bc-e59f85d5c3c9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Created reservations ['589cc4ed-7240-46b9-bd65-a06cfc6d793b', '21fabf2b-5406-406c-82d7-23077492fd08', 'f2d056d2-2d25-4a9b-a241-ca29d4e0818a', '74d73e21-6052-411a-8fb7-81ff2a42e82b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:42 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d" returned: 0 in 0.555s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:42 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d Nov 05 08:28:42 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:42 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:42 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:42 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-aa983c34-77cc-49f8-88fb-2aa3a838b11d" returned: 0 in 0.334s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "cinder-quobyte-aa983c34-77cc-49f8-88fb-2aa3a838b11d" released by "delete_volume" :: held 0.959s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Created reservations ['d41cde78-3751-4523-9804-1978630c041e', '995362ad-0032-4859-a8d9-5d8dad60732e', '2da01d50-f033-47e2-a4a1-4a50495cf7a1', '3849d5cd-61b7-4ab9-8350-e3bcff3e513e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:42 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0fbb0744-6eaa-47a9-868d-dac39179c439 tempest-GroupsTest-1792213258 None] Delete group completed successfully. Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:42 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:42 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:43 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Deleted volume successfully. Nov 05 08:28:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-60768402-5dec-498e-a869-4bda1d94bc63 tempest-AbsoluteLimitsTests-569960958 None] Lock "cinder-aa983c34-77cc-49f8-88fb-2aa3a838b11d-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:52 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=159,cinder:INSERT=50,cinder:UPDATE=169,cinder:DELETE=11 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:28:53 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:INSERT=24,cinder:UPDATE=90,cinder:SELECT=59,cinder:DELETE=5 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Flow 'volume_create_manager' (4ae18070-f968-403e-9059-c755639a74a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47b3735-7654-4470-a762-3c38efb1c541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47b3735-7654-4470-a762-3c38efb1c541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-773632484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6a1cd7-d495-4e54-bc98-a0d28d34103a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01edec40c0034d558522db4c6956c52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:54Z,use_quota=True,user_id='8379bb39f8b846848c29ab203c068618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b298ce-b179-4ea4-b5ce-50785d0ff7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b298ce-b179-4ea4-b5ce-50785d0ff7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05991c4c-420b-4d5d-92f5-ead2795f01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05991c4c-420b-4d5d-92f5-ead2795f01eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd6a1cd7-d495-4e54-bc98-a0d28d34103a', 'volume_name': 'volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e3a219-5da5-471e-a118-ab1349ef192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e3a219-5da5-471e-a118-ab1349ef192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720cbfd9-d92b-4ccf-b8f1-47dd3be07ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a', 'volume_size': 1} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-773632484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd6a1cd7-d495-4e54-bc98-a0d28d34103a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01edec40c0034d558522db4c6956c52a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:54Z,use_quota=True,user_id='8379bb39f8b846848c29ab203c068618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Creating volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:54 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a 1073741824 Nov 05 08:28:54 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Flow 'volume_create_manager' (c1e25b73-f379-437f-96f4-a2d070be53eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e769e095-e8bf-494e-b64e-b8d31ef4a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e769e095-e8bf-494e-b64e-b8d31ef4a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1182022039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1df734-7fe1-4f62-801b-f75dc8dd5c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce3b82a97e8a443eb1ebe6b5577f092c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:54Z,use_quota=True,user_id='ca749eb56e284259bd3508b81262273e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc5a567-f432-4a38-9719-17bea68f7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc5a567-f432-4a38-9719-17bea68f7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6f8ed7-320b-4e50-89c8-5e601e4e2446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6f8ed7-320b-4e50-89c8-5e601e4e2446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1df734-7fe1-4f62-801b-f75dc8dd5c11', 'volume_name': 'volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001da16f-7a22-4801-aef3-06319ab693e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001da16f-7a22-4801-aef3-06319ab693e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6786d87-c93d-4021-b4be-036382cb7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Volume 5b1df734-7fe1-4f62-801b-f75dc8dd5c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11', 'volume_size': 1} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:54 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a 1073741824" returned: 0 in 0.531s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:54 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a Nov 05 08:28:54 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:55 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" returned: 0 in 0.305s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1182022039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1df734-7fe1-4f62-801b-f75dc8dd5c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce3b82a97e8a443eb1ebe6b5577f092c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:54Z,use_quota=True,user_id='ca749eb56e284259bd3508b81262273e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Creating volume 5b1df734-7fe1-4f62-801b-f75dc8dd5c11 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720cbfd9-d92b-4ccf-b8f1-47dd3be07ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d89fb5a-87f3-476f-9061-e8863235bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:55 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 1073741824 Nov 05 08:28:55 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Volume volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a (cd6a1cd7-d495-4e54-bc98-a0d28d34103a): created successfully Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d89fb5a-87f3-476f-9061-e8863235bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Flow 'volume_create_manager' (4ae18070-f968-403e-9059-c755639a74a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1b29defa-814a-4a6a-a442-4a8831a5b64b tempest-SnapshotsActionsTest-471904401 None] Created volume successfully. Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cfb22194-4a11-4bc8-8d1e-77ada67e839e tempest-GroupsV314Test-1652023495 None] Group tempest-GroupsV314Test-Group-1341188532: creating Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cfb22194-4a11-4bc8-8d1e-77ada67e839e tempest-GroupsV314Test-1652023495 None] Group tempest-GroupsV314Test-Group-1341188532: created successfully Nov 05 08:28:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cfb22194-4a11-4bc8-8d1e-77ada67e839e tempest-GroupsV314Test-1652023495 None] Create group completed successfully. Nov 05 08:28:55 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 1073741824" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:55 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 Nov 05 08:28:55 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:56 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6786d87-c93d-4021-b4be-036382cb7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6c1813-903e-4e75-a615-eba10999131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Volume volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 (5b1df734-7fe1-4f62-801b-f75dc8dd5c11): created successfully Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6c1813-903e-4e75-a615-eba10999131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Flow 'volume_create_manager' (c1e25b73-f379-437f-96f4-a2d070be53eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ea97ba4c-08cd-415c-ae41-b26b76aab93e tempest-VolumesMetadataTest-1205802257 None] Created volume successfully. Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Creating offline snapshot 64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5546ba-6278-4fc1-b32c-180a0d71ed79]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:56 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a Nov 05 08:28:56 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Flow 'volume_create_manager' (ff91d212-0fcc-4263-a079-813acfdba2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a96f86-290e-43d7-930e-fd0449dd4790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a96f86-290e-43d7-930e-fd0449dd4790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-842048775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e12f203-855f-40e3-81b2-638f40301c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d1f21c313641259191d33f82a98638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:57Z,use_quota=True,user_id='e029712c028f474bb8e5ab6c501098ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c1fb8-b389-4b35-84a6-889b8e4ceee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c1fb8-b389-4b35-84a6-889b8e4ceee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876fb591-33c4-4184-82f6-b8274c22b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:28:57 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" returned: 0 in 0.559s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:57 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 1G Nov 05 08:28:57 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876fb591-33c4-4184-82f6-b8274c22b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e12f203-855f-40e3-81b2-638f40301c7c', 'volume_name': 'volume-6e12f203-855f-40e3-81b2-638f40301c7c', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6508046a-37ab-4ee8-8fe9-e428cd7bb497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6508046a-37ab-4ee8-8fe9-e428cd7bb497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152ae738-a7a4-45bc-84f9-cae17294d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Volume 6e12f203-855f-40e3-81b2-638f40301c7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e12f203-855f-40e3-81b2-638f40301c7c', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Trying to clone 6e12f203-855f-40e3-81b2-638f40301c7c from image 9dbb82da-9633-4e04-9ee8-18373a09d135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Flow 'volume_create_manager' (96a542f0-be58-4831-99f3-5200d299e52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca03837-a3fb-4504-a5ba-5eb57a2eccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca03837-a3fb-4504-a5ba-5eb57a2eccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546347893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9781c82b-a443-4fc2-b05a-185b82237198,host='devstack@QuobyteHD#QuobyteHD',id=300f62c8-5116-4d38-aafa-05248eddf6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e83ebde3b93497b9d13a246d06fc8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:57Z,use_quota=True,user_id='9d9b8f0f92394beaa1fd88a960a27e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad64708-b494-4934-9f80-2f32f5fdd2da),volume_type_id=8ad64708-b494-4934-9f80-2f32f5fdd2da)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81db505-7408-4144-83fa-9bfcb051b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81db505-7408-4144-83fa-9bfcb051b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c47253-148c-4372-a708-f879267ed975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c47253-148c-4372-a708-f879267ed975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300f62c8-5116-4d38-aafa-05248eddf6de', 'volume_name': 'volume-300f62c8-5116-4d38-aafa-05248eddf6de', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d85ae-9e78-4af7-8295-a812b6e502cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825d85ae-9e78-4af7-8295-a812b6e502cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ed49cd-f5b0-42e8-ac8a-0c7f7e836483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Volume 300f62c8-5116-4d38-aafa-05248eddf6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300f62c8-5116-4d38-aafa-05248eddf6de', 'volume_size': 1} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:57 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 1G" returned: 0 in 0.667s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:57 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:28:57 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Acquiring lock "cinder-5b1df734-7fe1-4f62-801b-f75dc8dd5c11-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "cinder-5b1df734-7fe1-4f62-801b-f75dc8dd5c11-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Acquiring lock "cinder-quobyte-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:28:57 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "cinder-quobyte-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eff1b5-a7d1-4833-ad93-0e69f3d2349f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5798191-970e-4946-9ce1-d32156b6b8cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 is being set with open permissions: ugo+rw Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 Nov 05 08:28:58 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD Nov 05 08:28:58 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:28:58 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 is fetched for user e029712c028f474bb8e5ab6c501098ec. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:28:58 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11 Nov 05 08:28:58 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info Nov 05 08:28:58 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f88154-d3d4-4d7c-af4d-b2c06facbd3b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD Nov 05 08:28:58 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "cinder-quobyte-5b1df734-7fe1-4f62-801b-f75dc8dd5c11" released by "delete_volume" :: held 0.755s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info is being set with open permissions: ugo+rw Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info Nov 05 08:28:58 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Created reservations ['ec09538c-ecd6-4730-bcee-aee97510507e', '5d169ac3-7ee9-4215-8b15-1e503db48f95', '6d74d15f-ba6f-46cb-ba16-d95ca5fa6175', 'aa477e24-9bfd-4aa4-8af6-0a39a1e93419'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:28:58 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:58 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:28:58 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:58 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9781c82b-a443-4fc2-b05a-185b82237198,created_at=2026-11-05T07:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1546347893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9781c82b-a443-4fc2-b05a-185b82237198,host='devstack@QuobyteHD#QuobyteHD',id=300f62c8-5116-4d38-aafa-05248eddf6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e83ebde3b93497b9d13a246d06fc8e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:57Z,use_quota=True,user_id='9d9b8f0f92394beaa1fd88a960a27e21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad64708-b494-4934-9f80-2f32f5fdd2da),volume_type_id=8ad64708-b494-4934-9f80-2f32f5fdd2da)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Creating volume 300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:59 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de 1073741824 Nov 05 08:28:59 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5c4f774f-c565-4f00-826b-003b3503ece5 tempest-SnapshotsActionsTest-471904401 None] Create snapshot completed successfully Nov 05 08:28:59 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Deleted volume successfully. Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1c49b715-6179-4536-ba2d-db40ff463a9f tempest-VolumesMetadataTest-1205802257 None] Lock "cinder-5b1df734-7fe1-4f62-801b-f75dc8dd5c11-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:28:59 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de 1073741824" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:59 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:28:59 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:59 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-842048775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e12f203-855f-40e3-81b2-638f40301c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d1f21c313641259191d33f82a98638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:28:57Z,use_quota=True,user_id='e029712c028f474bb8e5ab6c501098ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Creating volume 6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:28:59 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1073741824 Nov 05 08:28:59 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ed49cd-f5b0-42e8-ac8a-0c7f7e836483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300f62c8-5116-4d38-aafa-05248eddf6de', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06834cd-cd5c-47a9-80b4-1856d64318ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Volume volume-300f62c8-5116-4d38-aafa-05248eddf6de (300f62c8-5116-4d38-aafa-05248eddf6de): created successfully Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06834cd-cd5c-47a9-80b4-1856d64318ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:28:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Flow 'volume_create_manager' (96a542f0-be58-4831-99f3-5200d299e52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:28:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff62e53e-57fe-4709-87a2-472eed0ad45e tempest-GroupsV314Test-1652023495 None] Created volume successfully. Nov 05 08:29:00 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1073741824" returned: 0 in 0.563s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:00 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c Nov 05 08:29:00 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:00 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.189s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Creating offline snapshot 868c218c-5f49-41a5-b75d-e9a1d18ade07 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Attempting download of 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 6e12f203-855f-40e3-81b2-638f40301c7c. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9a0ec-4df9-442f-8822-e6ec3b78460c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3dca6f-d350-4a50-962c-93bf4cfb1b13]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:00 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:00 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:00 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g Nov 05 08:29:00 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:01 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:01 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:01 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 1G Nov 05 08:29:01 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:01 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g Nov 05 08:29:01 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:01 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g" returned: 1 in 0.431s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__4npdp1g' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6701ef-0b0a-4058-ac3d-f35b2bf9e3a7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:01 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 1G" returned: 0 in 0.538s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:01 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD Nov 05 08:29:01 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 Nov 05 08:29:01 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:01 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:02 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] 9dbb82da-9633-4e04-9ee8-18373a09d135 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07" returned: 0 in 0.412s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 is being set with open permissions: ugo+rw Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 Nov 05 08:29:02 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:02 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07" returned: 0 in 0.317s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.545s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Cloning volume 300f62c8-5116-4d38-aafa-05248eddf6de to volume f5180127-39a5-4ca2-bb31-4629e3eac94d Nov 05 08:29:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c671053c-0ee5-48a9-9c0d-b0827bc43f99 tempest-SnapshotsActionsTest-471904401 None] Create snapshot completed successfully Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Creating offline snapshot 8ce7600c-68f5-4c24-b11d-19d88c0b1f09 of volume 300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[34571046-bade-43f4-9d98-ad3e59b6f0bc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:02 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:29:02 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:03 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:03 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 1G Nov 05 08:29:03 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (eab30fcb-28f3-4e5d-acf5-60cb65a0732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8bb157-61db-4087-bfdc-007e13d9b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8bb157-61db-4087-bfdc-007e13d9b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-202535683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31acca61-1883-498a-a484-3bb3fefb9278,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:03Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28b5cdb-45e7-4e04-bc36-a35ab262c9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28b5cdb-45e7-4e04-bc36-a35ab262c9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301c4ba1-a8a0-4082-a295-83d308e3b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301c4ba1-a8a0-4082-a295-83d308e3b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31acca61-1883-498a-a484-3bb3fefb9278', 'volume_name': 'volume-31acca61-1883-498a-a484-3bb3fefb9278', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96e3a5c-bc8f-4665-b137-efc73146067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96e3a5c-bc8f-4665-b137-efc73146067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b7c4e-d91d-4dc0-9ff0-69c5dfca0a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Volume 31acca61-1883-498a-a484-3bb3fefb9278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31acca61-1883-498a-a484-3bb3fefb9278', 'volume_size': 1} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:03 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 1G" returned: 0 in 0.546s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300f62c8-5116-4d38-aafa-05248eddf6de -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:03 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300f62c8-5116-4d38-aafa-05248eddf6de -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:03 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-868c218c-5f49-41a5-b75d-e9a1d18ade07-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-868c218c-5f49-41a5-b75d-e9a1d18ade07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-868c218c-5f49-41a5-b75d-e9a1d18ade07" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-868c218c-5f49-41a5-b75d-e9a1d18ade07" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Deleting offline snapshot 868c218c-5f49-41a5-b75d-e9a1d18ade07 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] snapshot_file for this snap is: volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf240550-3351-43b1-923c-01d361636a36]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:03 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300f62c8-5116-4d38-aafa-05248eddf6de -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:04 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 Nov 05 08:29:04 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info Nov 05 08:29:04 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07" returned: 0 in 0.478s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3438271-73d6-41df-812f-eed7788fed4e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c" returned: 0 in 2.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_kfjor273devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:29:04 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Converted 112.00 MB image at 48.34 MB/s Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1G Nov 05 08:29:04 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:04 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info Nov 05 08:29:04 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c 1G" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Downloaded image 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume 6e12f203-855f-40e3-81b2-638f40301c7c successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:29:04 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 for user e029712c028f474bb8e5ab6c501098ec is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Marking volume 6e12f203-855f-40e3-81b2-638f40301c7c as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:04 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Copying metadata from image 9dbb82da-9633-4e04-9ee8-18373a09d135 to 6e12f203-855f-40e3-81b2-638f40301c7c. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Creating volume glance metadata for volume 6e12f203-855f-40e3-81b2-638f40301c7c backed by image 9dbb82da-9633-4e04-9ee8-18373a09d135 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:29:04 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:04 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.info" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Acquiring lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152ae738-a7a4-45bc-84f9-cae17294d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e12f203-855f-40e3-81b2-638f40301c7c', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17da297c-c65c-4625-bc9e-82a54bc59828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] snapshot: 8ce7600c-68f5-4c24-b11d-19d88c0b1f09, volume: f5180127-39a5-4ca2-bb31-4629e3eac94d, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Volume volume-6e12f203-855f-40e3-81b2-638f40301c7c (6e12f203-855f-40e3-81b2-638f40301c7c): created successfully Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17da297c-c65c-4625-bc9e-82a54bc59828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Flow 'volume_create_manager' (ff91d212-0fcc-4263-a079-813acfdba2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817ed46-3733-4449-bf6a-728f6f1f59c1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-644c066b-dd7d-46a3-afc8-94b649872066 tempest-TestShelveInstance-826406077 None] Created volume successfully. Nov 05 08:29:05 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:05 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:05 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07 Nov 05 08:29:05 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:05 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.419s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300f62c8-5116-4d38-aafa-05248eddf6de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b5779-62b9-481c-a5b8-d3558f795031]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.868c218c-5f49-41a5-b75d-e9a1d18ade07" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-868c218c-5f49-41a5-b75d-e9a1d18ade07" released by "_delete_snapshot" :: held 1.686s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_snapshot" :: held 1.725s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:05 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:29:05 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Created reservations ['0fa1485e-ef3c-4a40-8857-6cf685d66cab', '5830cd2e-0b1c-4c7a-b483-baebce13cf4f', '41af7b80-4275-42d9-a9df-9948101ee7b6', '43b06c86-b583-4b0e-8c53-3a04ddebe6af'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Delete snapshot completed successfully. Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6ef2d129-b84b-4157-96c1-e3d42e64b772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-868c218c-5f49-41a5-b75d-e9a1d18ade07-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:05 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:29:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:05 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d Nov 05 08:29:05 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a18cabb8-3ef6-4ddc-be77-546cb5c961cc req-a27b195a-8551-47fb-b120-e7f264776520 tempest-TestShelveInstance-826406077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:14 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d" returned: 0 in 8.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:29:14 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Converted 1024.00 MB image at 122.06 MB/s Nov 05 08:29:14 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d is being set with open permissions: ugo+rw: NotImplementedError Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:14 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d Nov 05 08:29:14 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:14 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" released by "_copy_volume_from_snapshot" :: held 9.527s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Acquiring lock "cinder-quobyte-8ce7600c-68f5-4c24-b11d-19d88c0b1f09" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-8ce7600c-68f5-4c24-b11d-19d88c0b1f09" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Deleting offline snapshot 8ce7600c-68f5-4c24-b11d-19d88c0b1f09 of volume 300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] snapshot_file for this snap is: volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0edaba-1e7f-4c9c-8b83-1f8e398f3506]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:14 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:14 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:14 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300f62c8-5116-4d38-aafa-05248eddf6de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df9cb7-915d-4bc2-a2ec-420e0b0aea98]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:29:15 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:15 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.507s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:15 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:15 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:15 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09 Nov 05 08:29:15 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:16 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de.8ce7600c-68f5-4c24-b11d-19d88c0b1f09" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-8ce7600c-68f5-4c24-b11d-19d88c0b1f09" released by "_delete_snapshot" :: held 1.526s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.542s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.553s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-202535683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31acca61-1883-498a-a484-3bb3fefb9278,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:03Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Creating volume 31acca61-1883-498a-a484-3bb3fefb9278 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:16 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 1073741824 Nov 05 08:29:16 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-518e9ad8-cb1f-458c-a39e-4e38cfc65127 tempest-GroupsV314Test-1652023495 None] Create group from source-group-9781c82b-a443-4fc2-b05a-185b82237198 completed successfully. Nov 05 08:29:16 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 1073741824" returned: 0 in 0.443s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:16 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 Nov 05 08:29:16 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:16 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.515s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9b7c4e-d91d-4dc0-9ff0-69c5dfca0a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31acca61-1883-498a-a484-3bb3fefb9278', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a9f1b1-2dd0-49cc-a0c9-0a9fdf67d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Creating offline snapshot 0f62dc15-ad08-4022-8223-08a59579ea30 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Volume volume-31acca61-1883-498a-a484-3bb3fefb9278 (31acca61-1883-498a-a484-3bb3fefb9278): created successfully Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a9f1b1-2dd0-49cc-a0c9-0a9fdf67d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (eab30fcb-28f3-4e5d-acf5-60cb65a0732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[24389505-8a29-4d79-8947-19135ace37dc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-df9217e7-c99b-4dd6-b3db-a83b3a0789be tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:29:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Acquiring lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fedfe90-48ca-4ee6-b842-f31e90810a7c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:17 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:17 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:17 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d Nov 05 08:29:17 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:17 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:17 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 1G Nov 05 08:29:17 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:17 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:17 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d Nov 05 08:29:17 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:17 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f5180127-39a5-4ca2-bb31-4629e3eac94d" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-f5180127-39a5-4ca2-bb31-4629e3eac94d" released by "delete_volume" :: held 0.734s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:17 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 1G" returned: 0 in 0.433s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:17 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 Nov 05 08:29:17 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Created reservations ['47efd9aa-ad93-4b8d-8dc6-6c3243b02638'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:17 devstack cinder-volume[87092]: WARNING cinder.quota [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2045093912 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2045093912, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:29:17 devstack cinder-volume[87092]: WARNING cinder.quota [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2045093912 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2045093912, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Created reservations ['57c771fa-dce1-4a60-a21b-c1072c70f3dc', '524f0ae7-994b-445b-9fd5-e6d75293d325', '63cc3b2b-cb52-493e-b638-51d243b6c0a4', '13d62e4b-7b28-4921-b382-99e31b093a2a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:18 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:18 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:18 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:18 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 is being set with open permissions: ugo+rw Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:18 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 Nov 05 08:29:18 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:18 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:18 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:18 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0b900fe3-e61e-4cd1-b5ae-154372e3be12 tempest-GroupsV314Test-1652023495 None] Delete group completed successfully. Nov 05 08:29:18 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a18cabb8-3ef6-4ddc-be77-546cb5c961cc req-a27b195a-8551-47fb-b120-e7f264776520 tempest-TestShelveInstance-826406077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.822s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-a18cabb8-3ef6-4ddc-be77-546cb5c961cc req-a27b195a-8551-47fb-b120-e7f264776520 tempest-TestShelveInstance-826406077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:18 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0d4d8c50-8206-4939-a5b9-46db9cfebedb tempest-SnapshotsActionsTest-471904401 None] Create snapshot completed successfully Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a18cabb8-3ef6-4ddc-be77-546cb5c961cc req-a27b195a-8551-47fb-b120-e7f264776520 tempest-TestShelveInstance-826406077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-6e12f203-855f-40e3-81b2-638f40301c7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e78f4175-9838-4ce6-ad8d-7cb2f0b1598b', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:29:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a18cabb8-3ef6-4ddc-be77-546cb5c961cc req-a27b195a-8551-47fb-b120-e7f264776520 tempest-TestShelveInstance-826406077 None] attachment_update completed successfully. Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Acquiring lock "cinder-quobyte-300f62c8-5116-4d38-aafa-05248eddf6de" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-300f62c8-5116-4d38-aafa-05248eddf6de" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7727b91e-608f-4e50-a441-0d986990039b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (94315760-c268-4055-bcb4-a8c0bc9c21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96cd69b-62b1-449c-a75e-87085f540fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96cd69b-62b1-449c-a75e-87085f540fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-439709106',display_name='tempest-VolumesGetTest-Volume-1781204907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c1e542-e0e2-405e-9c3f-f4224f41e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:19Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bc86b9-c29a-40e8-82ab-d8f14aa52999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bc86b9-c29a-40e8-82ab-d8f14aa52999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7339f4a8-70c5-405f-8f79-f00ef974a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7339f4a8-70c5-405f-8f79-f00ef974a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c1e542-e0e2-405e-9c3f-f4224f41e704', 'volume_name': 'volume-31c1e542-e0e2-405e-9c3f-f4224f41e704', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f7ec5c-b6c4-4262-9a76-5a0e386b4fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f7ec5c-b6c4-4262-9a76-5a0e386b4fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb31cb15-ae31-41cf-8808-6480b4a54826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Volume 31c1e542-e0e2-405e-9c3f-f4224f41e704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c1e542-e0e2-405e-9c3f-f4224f41e704', 'volume_size': 1} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-439709106',display_name='tempest-VolumesGetTest-Volume-1781204907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c1e542-e0e2-405e-9c3f-f4224f41e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:19Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Creating volume 31c1e542-e0e2-405e-9c3f-f4224f41e704 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:19 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:29:19 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-0f62dc15-ad08-4022-8223-08a59579ea30-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:19 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 1073741824 Nov 05 08:29:19 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-0f62dc15-ad08-4022-8223-08a59579ea30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-0f62dc15-ad08-4022-8223-08a59579ea30" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-0f62dc15-ad08-4022-8223-08a59579ea30" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Deleting offline snapshot 0f62dc15-ad08-4022-8223-08a59579ea30 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] snapshot_file for this snap is: volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f294ca-84b9-4a94-95be-c27a50f9b073]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:19 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 Nov 05 08:29:19 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:19 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.559s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:19 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de Nov 05 08:29:19 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:19 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30" returned: 0 in 0.662s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:19 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 1073741824" returned: 0 in 0.879s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44216c-3775-4815-80cb-be0647fe11f3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:20 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-300f62c8-5116-4d38-aafa-05248eddf6de" returned: 0 in 0.723s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:20 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 Nov 05 08:29:20 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Lock "cinder-quobyte-300f62c8-5116-4d38-aafa-05248eddf6de" released by "delete_volume" :: held 1.420s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:20 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:20 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Created reservations ['181eb952-2aa8-470a-b944-c967562e8b9a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Created reservations ['c04d7012-fc6a-47fd-9724-c81ebe72c184', 'e40e8bf2-6baf-467e-9cd0-2b9f55123dce', 'c9f168d8-ed48-459e-8a9e-6e83fc6fa78d', 'af7c5aa4-7740-47eb-90d6-7d23c3f793d5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:20 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704" returned: 0 in 0.540s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb31cb15-ae31-41cf-8808-6480b4a54826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c1e542-e0e2-405e-9c3f-f4224f41e704', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a8b52b-23a2-4021-a6e7-2a2b0d4c0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Volume volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 (31c1e542-e0e2-405e-9c3f-f4224f41e704): created successfully Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a8b52b-23a2-4021-a6e7-2a2b0d4c0866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:20 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (94315760-c268-4055-bcb4-a8c0bc9c21e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.751s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ea8fa8dd-80fc-48e9-a8b7-7b1e882159e6 tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:29:20 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 Nov 05 08:29:20 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:20 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:20 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:21 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-917d7f58-2612-4298-9e1d-d7b9c0649c6f tempest-GroupsV314Test-1652023495 None] Delete group completed successfully. Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-31c1e542-e0e2-405e-9c3f-f4224f41e704-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "cinder-31c1e542-e0e2-405e-9c3f-f4224f41e704-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:21 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-31c1e542-e0e2-405e-9c3f-f4224f41e704" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30" returned: 0 in 0.736s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-31c1e542-e0e2-405e-9c3f-f4224f41e704" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:21 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30 Nov 05 08:29:21 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cc1840-02a0-4033-9ad4-1f267a1a3e37]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:21 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 Nov 05 08:29:21 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:21 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.0f62dc15-ad08-4022-8223-08a59579ea30" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-0f62dc15-ad08-4022-8223-08a59579ea30" released by "_delete_snapshot" :: held 2.813s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_snapshot" :: held 2.859s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Created reservations ['fe09ed5d-855e-40aa-8d63-da7110f64b97', '69cfe578-5b76-43de-9649-f4f00ba2d369', '9aeb89a5-33a7-43ac-b7fd-9e2f5fe3c326', 'aa786c56-d185-4c02-94ba-c8ea43f69ee5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Delete snapshot completed successfully. Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56456c3a-3d96-4a27-8363-96a088c48d2f tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-0f62dc15-ad08-4022-8223-08a59579ea30-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:22 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704" returned: 0 in 0.695s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:22 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704 Nov 05 08:29:22 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:22 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31c1e542-e0e2-405e-9c3f-f4224f41e704" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-31c1e542-e0e2-405e-9c3f-f4224f41e704" released by "delete_volume" :: held 1.313s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Created reservations ['36a0859c-f46d-4614-a450-fbe14c9e44d1', '552bc1be-de53-4910-b42b-af7a9cbc5fde', 'd4ba9554-8e1b-40bf-8446-4cbae6d77e54', '9c692eb0-5d74-48d9-b6b6-19b81f6ed779'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:23 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:23 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Creating offline snapshot 6f343652-24b2-42a2-bd99-443f56f17e4d of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5b1a0-ab0d-472b-b975-b765ef8c6a86]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:23 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:23 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:23 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.374s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82871c9c-b673-49c9-923d-b8e515431981 tempest-VolumesGetTest-1289075865 None] Lock "cinder-31c1e542-e0e2-405e-9c3f-f4224f41e704-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-31acca61-1883-498a-a484-3bb3fefb9278-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "cinder-31acca61-1883-498a-a484-3bb3fefb9278-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:23 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.587s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:23 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d 1G Nov 05 08:29:23 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-31acca61-1883-498a-a484-3bb3fefb9278" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-31acca61-1883-498a-a484-3bb3fefb9278" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0cb732-6759-4465-86b8-a80d61063053]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:24 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 Nov 05 08:29:24 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:24 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d 1G" returned: 0 in 0.825s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:24 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278" returned: 0 in 0.731s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:24 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d Nov 05 08:29:24 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:24 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278 Nov 05 08:29:24 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:25 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d is being set with open permissions: ugo+rw Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:25 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d Nov 05 08:29:25 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:25 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-31acca61-1883-498a-a484-3bb3fefb9278" returned: 0 in 0.601s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-31acca61-1883-498a-a484-3bb3fefb9278" released by "delete_volume" :: held 1.416s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Created reservations ['1853b174-b00a-4cfc-9e0a-c191d82afba7', 'b3b5b75a-7358-4b73-b85d-d9c19f6ba0a8', '41457f53-629b-446a-bdc0-52d1fd0690d8', '974b2429-9dd9-4d60-9e71-945a27917376'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:25 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d" returned: 0 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8cbfab37-2ced-4ea7-9f9a-64652b82e97d tempest-SnapshotsActionsTest-471904401 None] Create snapshot completed successfully Nov 05 08:29:25 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:25 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:26 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-434e297e-fd0a-4d3b-928b-74c9cc4e97d2 tempest-VolumesGetTest-1289075865 None] Lock "cinder-31acca61-1883-498a-a484-3bb3fefb9278-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-6f343652-24b2-42a2-bd99-443f56f17e4d-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-6f343652-24b2-42a2-bd99-443f56f17e4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-6f343652-24b2-42a2-bd99-443f56f17e4d" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-6f343652-24b2-42a2-bd99-443f56f17e4d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Deleting offline snapshot 6f343652-24b2-42a2-bd99-443f56f17e4d of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] snapshot_file for this snap is: volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e663d-1c14-4200-9aed-08199c3f2b70]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:27 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d Nov 05 08:29:27 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (41ecf042-4031-42c6-b4b3-2acd90f571c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edeadb16-3985-471e-bf71-e7c3248df128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edeadb16-3985-471e-bf71-e7c3248df128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1992274695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265750e8-aa73-464a-a9c8-4a0a980349b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:27Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac18f14-d20f-4b80-87ee-eddd3493bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac18f14-d20f-4b80-87ee-eddd3493bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a60d6-88aa-4a37-a5d1-5527d7d74f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a60d6-88aa-4a37-a5d1-5527d7d74f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265750e8-aa73-464a-a9c8-4a0a980349b2', 'volume_name': 'volume-265750e8-aa73-464a-a9c8-4a0a980349b2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5edfb10-e923-45da-ada8-07cab0283528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5edfb10-e923-45da-ada8-07cab0283528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fc5e1c-c873-4a5f-af70-ad5be36ba7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Volume 265750e8-aa73-464a-a9c8-4a0a980349b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265750e8-aa73-464a-a9c8-4a0a980349b2', 'volume_size': 1} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1992274695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265750e8-aa73-464a-a9c8-4a0a980349b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:27Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Creating volume 265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:27 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 1073741824 Nov 05 08:29:27 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:27 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d" returned: 0 in 0.714s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[837a293b-ac15-4ba2-8608-e47372c6e0cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:27 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:27 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:28 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 1073741824" returned: 0 in 0.760s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:28 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:28 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:28 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.599s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:28 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d Nov 05 08:29:28 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:28 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fc5e1c-c873-4a5f-af70-ad5be36ba7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265750e8-aa73-464a-a9c8-4a0a980349b2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e843bb-fb6e-45eb-a251-ebde750c3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Volume volume-265750e8-aa73-464a-a9c8-4a0a980349b2 (265750e8-aa73-464a-a9c8-4a0a980349b2): created successfully Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e843bb-fb6e-45eb-a251-ebde750c3af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (41ecf042-4031-42c6-b4b3-2acd90f571c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:28 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d" returned: 0 in 0.534s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-22abb0a7-9588-4aa9-8333-111dccc81968 tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:29:28 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d Nov 05 08:29:28 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:29 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.6f343652-24b2-42a2-bd99-443f56f17e4d" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-6f343652-24b2-42a2-bd99-443f56f17e4d" released by "_delete_snapshot" :: held 2.407s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_snapshot" :: held 2.452s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Created reservations ['5d101bec-0c30-48e6-8757-ab96dfa00922', '5ebcf3ec-f38b-4d67-8604-f223a1703c65', 'e8b86e17-8b56-45cf-ae51-660155ef41c4', '22e65d76-1c6a-4c83-99e6-7cd4e99fcecc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Delete snapshot completed successfully. Nov 05 08:29:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-61407595-8e52-4658-b5bf-db7cd57a6772 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-6f343652-24b2-42a2-bd99-443f56f17e4d-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (c9895151-cf74-46a2-ba94-dfa6d0d31f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ff62fd-3bee-4b67-89c8-5bbdd0a37522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ff62fd-3bee-4b67-89c8-5bbdd0a37522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1120447043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca5ad08-24a9-47fe-907a-941fd33a8bab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=265750e8-aa73-464a-a9c8-4a0a980349b2,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:30Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5644e25d-b0a8-49ad-a88b-231ee4f39f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5644e25d-b0a8-49ad-a88b-231ee4f39f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d873643a-c358-4f6f-80eb-375d9661ccf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d873643a-c358-4f6f-80eb-375d9661ccf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ca5ad08-24a9-47fe-907a-941fd33a8bab', 'volume_name': 'volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab', 'volume_size': 1, 'source_volid': '265750e8-aa73-464a-a9c8-4a0a980349b2', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8372d5ad-f9b1-46dd-955c-ae01bcc6f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8372d5ad-f9b1-46dd-955c-ae01bcc6f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdaf586-f01e-4da6-82d8-d8d08bbf3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:30 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Volume 8ca5ad08-24a9-47fe-907a-941fd33a8bab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab', 'volume_size': 1, 'source_volid': '265750e8-aa73-464a-a9c8-4a0a980349b2', 'source_volstatus': 'available'} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:30 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Cloning volume 265750e8-aa73-464a-a9c8-4a0a980349b2 to volume 8ca5ad08-24a9-47fe-907a-941fd33a8bab Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Creating offline snapshot 1d7542ab-82fb-4aaf-ae93-0f18f5753865 of volume 265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[839b027b-21d6-4601-9ebd-3f2897f7f832]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:30 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:30 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:31 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:31 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 1G Nov 05 08:29:31 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:31 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 1G" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265750e8-aa73-464a-a9c8-4a0a980349b2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:31 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265750e8-aa73-464a-a9c8-4a0a980349b2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:31 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:31 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265750e8-aa73-464a-a9c8-4a0a980349b2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 is being set with open permissions: ugo+rw Nov 05 08:29:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:31 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:31 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:32 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:32 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info Nov 05 08:29:32 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:32 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info is being set with open permissions: ugo+rw Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:32 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info Nov 05 08:29:32 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:32 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.info" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] snapshot: 1d7542ab-82fb-4aaf-ae93-0f18f5753865, volume: 8ca5ad08-24a9-47fe-907a-941fd33a8bab, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3acfb2-70f1-4c2a-a8c3-26e30876ab62]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:33 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:33 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:33 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265750e8-aa73-464a-a9c8-4a0a980349b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd9e96-c7e8-4738-b107-200a48a63aee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:33 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:33 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:33 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:29:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:33 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab Nov 05 08:29:33 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:41 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab" returned: 0 in 8.197s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:41 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:29:41 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Converted 1024.00 MB image at 124.90 MB/s Nov 05 08:29:41 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab is being set with open permissions: ugo+rw Nov 05 08:29:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:42 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab Nov 05 08:29:42 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=91,cinder:INSERT=34,cinder:DELETE=7,cinder:SELECT=103 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=91,cinder:UPDATE=102,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:29:42 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" released by "_copy_volume_from_snapshot" :: held 9.425s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-1d7542ab-82fb-4aaf-ae93-0f18f5753865" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-1d7542ab-82fb-4aaf-ae93-0f18f5753865" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Deleting offline snapshot 1d7542ab-82fb-4aaf-ae93-0f18f5753865 of volume 265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] snapshot_file for this snap is: volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9dfcc9-bd47-4d98-b0ec-50dd090c46ae]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:42 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:42 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:42 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.414s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265750e8-aa73-464a-a9c8-4a0a980349b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeab631-f58f-44d9-a296-70ed35e28344]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:42 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:42 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:43 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.541s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:43 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:43 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:43 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:43 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865 Nov 05 08:29:43 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:43 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2.1d7542ab-82fb-4aaf-ae93-0f18f5753865" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-1d7542ab-82fb-4aaf-ae93-0f18f5753865" released by "_delete_snapshot" :: held 1.620s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.411s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.215s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Creating offline snapshot 3becd53f-62f7-492f-857f-fb93160c5778 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdaf586-f01e-4da6-82d8-d8d08bbf3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab', 'volume_size': 1, 'source_volid': '265750e8-aa73-464a-a9c8-4a0a980349b2', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f82328-e0e2-4a69-8e97-b5be34aaf1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9aee77-1ebd-4445-a994-32bd2566b3e8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Volume volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab (8ca5ad08-24a9-47fe-907a-941fd33a8bab): created successfully Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f82328-e0e2-4a69-8e97-b5be34aaf1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (c9895151-cf74-46a2-ba94-dfa6d0d31f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-50b7525c-bba5-49d1-9e5d-5e2c156ce2c6 tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:29:44 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:44 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:44 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:44 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 1G Nov 05 08:29:44 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:44 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 1G" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:44 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 Nov 05 08:29:44 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:45 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:45 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 is being set with open permissions: ugo+rw Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:45 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 Nov 05 08:29:45 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:45 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.628s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (92348822-b9cf-40d7-a481-bb11bbb83516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408d9f13-67eb-4382-abf8-d3515c574713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8f52d6f2-554a-456e-9427-5d62415a6546 tempest-SnapshotsActionsTest-471904401 None] Create snapshot completed successfully Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408d9f13-67eb-4382-abf8-d3515c574713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841414856',display_name='tempest-VolumesGetTest-Volume-1658347151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c00e5f-e61c-4305-8579-3d831ce83c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:46Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a03cd6-89b8-4267-8f99-7a0101853ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a03cd6-89b8-4267-8f99-7a0101853ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d36035a-7a3d-4740-8607-d4cb7225388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d36035a-7a3d-4740-8607-d4cb7225388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c00e5f-e61c-4305-8579-3d831ce83c33', 'volume_name': 'volume-99c00e5f-e61c-4305-8579-3d831ce83c33', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5935d539-cf88-400e-8a8c-e5db80229749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5935d539-cf88-400e-8a8c-e5db80229749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b352c63-4c15-4928-96d5-553439cabdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Volume 99c00e5f-e61c-4305-8579-3d831ce83c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c00e5f-e61c-4305-8579-3d831ce83c33', 'volume_size': 1} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841414856',display_name='tempest-VolumesGetTest-Volume-1658347151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c00e5f-e61c-4305-8579-3d831ce83c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:46Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Creating volume 99c00e5f-e61c-4305-8579-3d831ce83c33 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:29:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:45 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 1073741824 Nov 05 08:29:45 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:46 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 1073741824" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:46 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 Nov 05 08:29:46 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:46 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b352c63-4c15-4928-96d5-553439cabdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c00e5f-e61c-4305-8579-3d831ce83c33', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34898661-b690-42b1-93e2-a54e3561d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Volume volume-99c00e5f-e61c-4305-8579-3d831ce83c33 (99c00e5f-e61c-4305-8579-3d831ce83c33): created successfully Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34898661-b690-42b1-93e2-a54e3561d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (92348822-b9cf-40d7-a481-bb11bbb83516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5e51902b-5bae-47d8-89ed-f327bdf513ca tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-3becd53f-62f7-492f-857f-fb93160c5778-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-3becd53f-62f7-492f-857f-fb93160c5778-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Acquiring lock "cinder-quobyte-3becd53f-62f7-492f-857f-fb93160c5778" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-3becd53f-62f7-492f-857f-fb93160c5778" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Deleting offline snapshot 3becd53f-62f7-492f-857f-fb93160c5778 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] snapshot_file for this snap is: volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9ef04-3707-4f6d-9504-ef93c0cee49c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:46 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 Nov 05 08:29:46 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:47 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b231da2-91cb-42f0-9b3d-7b34df52a568]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:47 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:47 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-99c00e5f-e61c-4305-8579-3d831ce83c33-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "cinder-99c00e5f-e61c-4305-8579-3d831ce83c33-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-99c00e5f-e61c-4305-8579-3d831ce83c33" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-99c00e5f-e61c-4305-8579-3d831ce83c33" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4439be13-3d2f-4702-a1ba-0c6aecd4ecd5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:47 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.458s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:47 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 Nov 05 08:29:47 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:47 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 Nov 05 08:29:47 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:48 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:48 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33 Nov 05 08:29:48 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:48 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:48 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778 Nov 05 08:29:48 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:48 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-99c00e5f-e61c-4305-8579-3d831ce83c33" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-99c00e5f-e61c-4305-8579-3d831ce83c33" released by "delete_volume" :: held 0.756s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Created reservations ['a47c322e-05f2-4db6-aa3c-580c408c1613', '43eafd83-62d3-4532-98e5-6747614242da', '4112bb2b-d6ed-460c-87e9-af64ebd450ce', '1b346435-0a24-428c-8644-a69f8e609b55'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:48 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.3becd53f-62f7-492f-857f-fb93160c5778" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:48 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-3becd53f-62f7-492f-857f-fb93160c5778" released by "_delete_snapshot" :: held 1.784s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_snapshot" :: held 1.824s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Created reservations ['e74ddf63-8e5a-455b-baee-0e0314bc6379', 'fd198261-a8d8-414d-a9ef-410981b35f31', '918198f8-d664-43c6-9237-deae63d3ddff', '2f0f3863-f627-4cdd-9c2a-be52534a61b5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-8ca5ad08-24a9-47fe-907a-941fd33a8bab-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Delete snapshot completed successfully. Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-656177b0-a69b-4d78-9722-a0c75f2aa671 tempest-SnapshotsActionsTest-1201788912 None] Lock "cinder-3becd53f-62f7-492f-857f-fb93160c5778-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "cinder-8ca5ad08-24a9-47fe-907a-941fd33a8bab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:48 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ec4d4c3b-e30c-4719-b47b-e312af604a6f tempest-VolumesGetTest-1289075865 None] Lock "cinder-99c00e5f-e61c-4305-8579-3d831ce83c33-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9cee06-f22a-464e-8622-ac127022e4ef]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:49 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab Nov 05 08:29:49 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:49 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab" returned: 0 in 0.509s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:49 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab Nov 05 08:29:49 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:49 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8ca5ad08-24a9-47fe-907a-941fd33a8bab" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-8ca5ad08-24a9-47fe-907a-941fd33a8bab" released by "delete_volume" :: held 0.929s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "cinder-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "cinder-quobyte-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Deleting offline snapshot 64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 of volume cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] snapshot_file for this snap is: volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Created reservations ['0c011f03-5398-448d-890b-7552ce8d9e5a', '300b9dcc-8b1a-42ef-ba86-cb1a5b141302', 'f379a5df-e29e-4bb0-8c4e-f3e7ef0159c0', '1af6d7a1-c101-4f95-a8a8-3005c86ddf10'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd6833c-362a-405c-8d7f-a239e8bb5ccf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:50 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:50 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:50 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:50 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:50 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.328s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad0f6ba9-d32a-4c51-857a-1020740228f9 tempest-VolumesGetTest-1289075865 None] Lock "cinder-8ca5ad08-24a9-47fe-907a-941fd33a8bab-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:50 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da9b93-b822-4ab8-a1ef-e8e380ceb9ee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:50 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a Nov 05 08:29:50 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:51 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" returned: 0 in 0.400s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:51 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:51 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-265750e8-aa73-464a-a9c8-4a0a980349b2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "cinder-265750e8-aa73-464a-a9c8-4a0a980349b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-265750e8-aa73-464a-a9c8-4a0a980349b2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-265750e8-aa73-464a-a9c8-4a0a980349b2" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2edb1e-40ef-4202-bf1d-f012e0b85006]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:51 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.461s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:51 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4 Nov 05 08:29:51 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:51 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:51 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:51 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a.64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" returned: 0 in 0.305s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:51 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4" released by "_delete_snapshot" :: held 1.893s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_snapshot" :: held 1.933s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:51 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2 Nov 05 08:29:51 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Created reservations ['4d1ae209-d0da-4dd8-8a3e-4a30145d6e20', 'd9c9ea0a-b509-4786-a6b4-1926e6cc6e7d', 'd7bc27f3-509f-4612-a6b3-3b3bcb5fcef1', '19783094-5a26-476d-b96c-b87a62146553'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Delete snapshot completed successfully. Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3676bad1-5e10-4cf2-b9d1-f042f18a8859 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-64129ae1-80ec-449f-9bf6-4bb5cb4eb5c4-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:52 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-265750e8-aa73-464a-a9c8-4a0a980349b2" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "cinder-cd6a1cd7-d495-4e54-bc98-a0d28d34103a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-265750e8-aa73-464a-a9c8-4a0a980349b2" released by "delete_volume" :: held 0.879s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-cd6a1cd7-d495-4e54-bc98-a0d28d34103a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Created reservations ['bc16f96d-cc43-4861-baae-d937f308794d', 'fe84cea1-4281-496e-b2ae-0d7f064e4224', '3eb992cd-6d61-4620-978b-07be52d75393', '12223293-cf3b-4647-a105-77aa00f7e3bb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7f040-8b8b-4458-af77-990e065a46b5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:52 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:52 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:52 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a Nov 05 08:29:52 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:52 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96fd950a-58b7-46d1-8a54-c22925fe57eb tempest-VolumesGetTest-1289075865 None] Lock "cinder-265750e8-aa73-464a-a9c8-4a0a980349b2-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:52 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" returned: 0 in 0.481s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:52 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a Nov 05 08:29:52 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:53 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-quobyte-cd6a1cd7-d495-4e54-bc98-a0d28d34103a" released by "delete_volume" :: held 0.835s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Created reservations ['99e4150b-098c-4c7f-ad26-a7e1b589338b', 'e45886b4-cbd5-4fa8-91af-4f1d7864a5b0', 'f4777d27-0267-4478-afb9-dbffaccf659b', 'f4bd0677-ecf0-4002-b0a3-925333d5f865'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:53 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:29:53 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:53 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:29:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Deleted volume successfully. Nov 05 08:29:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f46a2f9-9e36-426c-a98f-0fbfa7de3491 tempest-SnapshotsActionsTest-471904401 None] Lock "cinder-cd6a1cd7-d495-4e54-bc98-a0d28d34103a-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (7b9598cf-4412-46cb-abf7-7fa98eb97c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801d0905-ebe1-4d4a-8102-c476fae84b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801d0905-ebe1-4d4a-8102-c476fae84b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-252298333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fe675c-aeb2-4c39-aa6a-6258313f35b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:55Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2274cf-5c0d-410f-92ea-6ddcba5a9d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2274cf-5c0d-410f-92ea-6ddcba5a9d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fb2e3-77ef-4291-9beb-ab9f4cee72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:54 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983fb2e3-77ef-4291-9beb-ab9f4cee72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3fe675c-aeb2-4c39-aa6a-6258313f35b7', 'volume_name': 'volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f216ab7-a6c0-4895-b7b8-430f3183358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f216ab7-a6c0-4895-b7b8-430f3183358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c749c3b4-946b-41ce-b171-778bb5fde9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:29:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Trying to clone e3fe675c-aeb2-4c39-aa6a-6258313f35b7 from image 9dbb82da-9633-4e04-9ee8-18373a09d135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:29:55 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Image download 20.69 MB at 20.69 MB/s Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680c11e-2950-481d-96c6-55b405a2a078]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:55 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD Nov 05 08:29:55 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 is fetched for user 0f0ea05cb3d44646a6a7a57f0bb51d67. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d583f7-21b0-4a66-bf26-851471e31466]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD Nov 05 08:29:56 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:56 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-252298333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fe675c-aeb2-4c39-aa6a-6258313f35b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:29:55Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Creating volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:29:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:29:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:56 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1073741824 Nov 05 08:29:56 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1073741824" returned: 0 in 0.531s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 Nov 05 08:29:57 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Attempting download of 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e7024-e105-4c2f-83ac-0ef39c7d4fce]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_ {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:57 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_ Nov 05 08:29:57 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:57 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_ {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_ Nov 05 08:29:58 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:58 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_" returned: 1 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dbb82da-9633-4e04-9ee8-18373a09d135__1ktzfe_' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc3e3e-4adf-454f-9e74-af582b85f504]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD Nov 05 08:29:58 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:29:58 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] 9dbb82da-9633-4e04-9ee8-18373a09d135 was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:29:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:29:58 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 Nov 05 08:29:58 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Flow 'volume_create_manager' (60a0ba7b-2fbf-4ccf-acbf-736c404bec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb20e6c6-51d0-4946-8a59-1aadd287c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb20e6c6-51d0-4946-8a59-1aadd287c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1928682648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0557565-eee8-4550-a06f-a940354ba90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c753749bfc40919512285dc7e5937a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:01Z,use_quota=True,user_id='c64680898dc2412f89b42f3ea56c6d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fec4e8-c21a-403a-8b6f-6b473d45fb96),volume_type_id=a4fec4e8-c21a-403a-8b6f-6b473d45fb96)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0193a161-2f72-47e5-8041-c6a5244625f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0193a161-2f72-47e5-8041-c6a5244625f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f224c4f-cc8d-44f4-bac0-0362c2572fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f224c4f-cc8d-44f4-bac0-0362c2572fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0557565-eee8-4550-a06f-a940354ba90d', 'volume_name': 'volume-e0557565-eee8-4550-a06f-a940354ba90d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b9d0a9-dbfb-4321-8852-868441c4c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b9d0a9-dbfb-4321-8852-868441c4c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d9384-34bd-459e-8feb-e31e4b1d5607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Volume e0557565-eee8-4550-a06f-a940354ba90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0557565-eee8-4550-a06f-a940354ba90d', 'volume_size': 1} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1928682648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0557565-eee8-4550-a06f-a940354ba90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c753749bfc40919512285dc7e5937a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:01Z,use_quota=True,user_id='c64680898dc2412f89b42f3ea56c6d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fec4e8-c21a-403a-8b6f-6b473d45fb96),volume_type_id=a4fec4e8-c21a-403a-8b6f-6b473d45fb96)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Creating volume e0557565-eee8-4550-a06f-a940354ba90d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:00 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d 1073741824 Nov 05 08:30:00 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:00 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" returned: 0 in 2.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dbb82da-9633-4e04-9ee8-18373a09d135_l02lvw9vdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:30:00 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Converted 112.00 MB image at 49.42 MB/s Nov 05 08:30:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:01 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1G Nov 05 08:30:01 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Flow 'volume_create_manager' (de44caa7-bcf8-42f1-9502-5e680d4e2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a0f28-bf2a-4f58-85ee-45aa8fbcd7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a0f28-bf2a-4f58-85ee-45aa8fbcd7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1182669128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c93bd-4794-481e-9805-909484c6275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9e7d42b244e75a31d782e3933b721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:01Z,use_quota=True,user_id='556ad40e49e74d79a9dfad0d6bff3f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5e9fb3-a7b1-4a49-a36f-12f5c2265cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5e9fb3-a7b1-4a49-a36f-12f5c2265cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1eb05-7623-48fa-bff6-1c04001f27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1eb05-7623-48fa-bff6-1c04001f27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0c93bd-4794-481e-9805-909484c6275e', 'volume_name': 'volume-1d0c93bd-4794-481e-9805-909484c6275e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9aab1-6b65-4432-8637-2ac521262069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9aab1-6b65-4432-8637-2ac521262069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e48720b-19ac-4c99-89b0-ed2c8f13c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume 1d0c93bd-4794-481e-9805-909484c6275e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0c93bd-4794-481e-9805-909484c6275e', 'volume_size': 1} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 1G" returned: 0 in 0.706s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Downloaded image 9dbb82da-9633-4e04-9ee8-18373a09d135 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}])) to volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Temporary image 9dbb82da-9633-4e04-9ee8-18373a09d135 for user 0f0ea05cb3d44646a6a7a57f0bb51d67 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Marking volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Copying metadata from image 9dbb82da-9633-4e04-9ee8-18373a09d135 to e3fe675c-aeb2-4c39-aa6a-6258313f35b7. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Creating volume glance metadata for volume e3fe675c-aeb2-4c39-aa6a-6258313f35b7 backed by image 9dbb82da-9633-4e04-9ee8-18373a09d135 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:30:01 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d 1073741824" returned: 0 in 0.869s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:01 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d Nov 05 08:30:01 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c749c3b4-946b-41ce-b171-778bb5fde9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7', 'volume_size': 1, 'image_id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dbb82da-9633-4e04-9ee8-18373a09d135', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf806a381b5948439ee789e7d4767edc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dbb82da-9633-4e04-9ee8-18373a09d135', 'created_at': datetime.datetime(2026, 11, 5, 7, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 15, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dbb82da-9633-4e04-9ee8-18373a09d135/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e8c264-f37e-4f3b-8e14-fa9c6b4cd522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Volume volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 (e3fe675c-aeb2-4c39-aa6a-6258313f35b7): created successfully Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e8c264-f37e-4f3b-8e14-fa9c6b4cd522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (7b9598cf-4412-46cb-abf7-7fa98eb97c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8b418aaa-f4c7-42cc-a709-1b27e190a48a tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:30:02 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1182669128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c93bd-4794-481e-9805-909484c6275e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9e7d42b244e75a31d782e3933b721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:01Z,use_quota=True,user_id='556ad40e49e74d79a9dfad0d6bff3f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Creating volume 1d0c93bd-4794-481e-9805-909484c6275e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3d9384-34bd-459e-8feb-e31e4b1d5607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0557565-eee8-4550-a06f-a940354ba90d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e292a3c-ee51-44f4-88b5-0e1076f37935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e 1073741824 Nov 05 08:30:02 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Volume volume-e0557565-eee8-4550-a06f-a940354ba90d (e0557565-eee8-4550-a06f-a940354ba90d): created successfully Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e292a3c-ee51-44f4-88b5-0e1076f37935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Flow 'volume_create_manager' (60a0ba7b-2fbf-4ccf-acbf-736c404bec91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a3d40fd5-9e94-4194-b4f4-5632ad4f1bf7 tempest-VolumeTypesAccessTest-189528 None] Created volume successfully. Nov 05 08:30:02 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e 1073741824" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:02 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e Nov 05 08:30:02 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:02 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e48720b-19ac-4c99-89b0-ed2c8f13c613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0c93bd-4794-481e-9805-909484c6275e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e155dded-e5be-40eb-a6a3-53a7898716fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume volume-1d0c93bd-4794-481e-9805-909484c6275e (1d0c93bd-4794-481e-9805-909484c6275e): created successfully Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e155dded-e5be-40eb-a6a3-53a7898716fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Flow 'volume_create_manager' (de44caa7-bcf8-42f1-9502-5e680d4e2907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c1c8f081-5d0e-479b-a151-7f09a601227d tempest-VolumeQuotasAdminTestJSON-1195330730 None] Created volume successfully. Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (58f2cf20-b570-49a6-bba3-a88865cfe311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca6c2c8-7855-40b1-8ae9-bdd4994527d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Acquiring lock "cinder-e0557565-eee8-4550-a06f-a940354ba90d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca6c2c8-7855-40b1-8ae9-bdd4994527d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1216208816',display_name='tempest-VolumesGetTest-Volume-1495122440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4febfa11-99ed-40fc-827b-62b610649bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:03Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac1a1d7-0958-4f2e-bcf5-7362890572ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac1a1d7-0958-4f2e-bcf5-7362890572ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180cc6c3-efda-4569-93de-e0fda389aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180cc6c3-efda-4569-93de-e0fda389aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4febfa11-99ed-40fc-827b-62b610649bd6', 'volume_name': 'volume-4febfa11-99ed-40fc-827b-62b610649bd6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df601ff6-8df9-4e7d-b2fb-49d92c972fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df601ff6-8df9-4e7d-b2fb-49d92c972fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e335fd80-7e34-44f6-8b8e-ac394281210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Volume 4febfa11-99ed-40fc-827b-62b610649bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4febfa11-99ed-40fc-827b-62b610649bd6', 'volume_size': 1} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1216208816',display_name='tempest-VolumesGetTest-Volume-1495122440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4febfa11-99ed-40fc-827b-62b610649bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c749659dea264d3d92127730476fc3c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:03Z,use_quota=True,user_id='0f0ea05cb3d44646a6a7a57f0bb51d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Creating volume 4febfa11-99ed-40fc-827b-62b610649bd6 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "cinder-e0557565-eee8-4550-a06f-a940354ba90d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:03 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 1073741824 Nov 05 08:30:03 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Acquiring lock "cinder-quobyte-e0557565-eee8-4550-a06f-a940354ba90d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "cinder-quobyte-e0557565-eee8-4550-a06f-a940354ba90d" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e08d38f-4cae-4f69-a5cb-ec904841f4fb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d Nov 05 08:30:03 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 1073741824" returned: 0 in 0.442s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 Nov 05 08:30:03 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d" returned: 0 in 0.415s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d Nov 05 08:30:03 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "cinder-1d0c93bd-4794-481e-9805-909484c6275e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "cinder-1d0c93bd-4794-481e-9805-909484c6275e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "cinder-quobyte-1d0c93bd-4794-481e-9805-909484c6275e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "cinder-quobyte-1d0c93bd-4794-481e-9805-909484c6275e" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:03 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e335fd80-7e34-44f6-8b8e-ac394281210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4febfa11-99ed-40fc-827b-62b610649bd6', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0edc8-f10a-41a1-891a-aa6b309dc28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b5d02-7e0a-4c86-b8b9-36a3dcb26634]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e0557565-eee8-4550-a06f-a940354ba90d" returned: 0 in 0.290s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "cinder-quobyte-e0557565-eee8-4550-a06f-a940354ba90d" released by "delete_volume" :: held 0.760s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Volume volume-4febfa11-99ed-40fc-827b-62b610649bd6 (4febfa11-99ed-40fc-827b-62b610649bd6): created successfully Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0edc8-f10a-41a1-891a-aa6b309dc28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Flow 'volume_create_manager' (58f2cf20-b570-49a6-bba3-a88865cfe311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f41a62c9-62fb-43c0-9cfc-e0f1462f2eec tempest-VolumesGetTest-1289075865 None] Created volume successfully. Nov 05 08:30:03 devstack cinder-volume[87092]: WARNING cinder.quota [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1658452669 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1658452669, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:03 devstack cinder-volume[87092]: WARNING cinder.quota [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1658452669 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1658452669, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Created reservations ['94870527-8a37-4bba-9430-359f41a5d52b', 'e59b7b75-7214-4be2-80e5-50690aca50f9', 'ebab92a0-377f-4764-8785-8e82219128c0', 'aa85ac45-ee93-4bb5-92c4-785251a05f3a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:03 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e Nov 05 08:30:03 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:03 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:03 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:04 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:04 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:04 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e Nov 05 08:30:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Deleted volume successfully. Nov 05 08:30:04 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6cdae63a-2d58-4bfa-9b79-9959faaaaf0c tempest-VolumeTypesAccessTest-189528 None] Lock "cinder-e0557565-eee8-4550-a06f-a940354ba90d-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:04 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1d0c93bd-4794-481e-9805-909484c6275e" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "cinder-quobyte-1d0c93bd-4794-481e-9805-909484c6275e" released by "delete_volume" :: held 0.764s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Created reservations ['7c8aa274-e35e-4ab9-9e1c-bfc6b84cf3d0', '86d66e87-bdf9-428c-9721-560f5f508715', 'f292de24-8242-4400-8d91-e7222ccf22dc', 'de556710-ad3e-4dcd-8393-7e9573a073be'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:04 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:04 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:04 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Deleted volume successfully. Nov 05 08:30:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d55397d-01a5-4575-88c8-4e4e1021aced tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "cinder-1d0c93bd-4794-481e-9805-909484c6275e-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-4febfa11-99ed-40fc-827b-62b610649bd6-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "cinder-4febfa11-99ed-40fc-827b-62b610649bd6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-4febfa11-99ed-40fc-827b-62b610649bd6" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-4febfa11-99ed-40fc-827b-62b610649bd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa846f4-df90-4da2-ab0f-1a6e5f93989c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:05 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 Nov 05 08:30:05 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Flow 'volume_create_manager' (2b324bf0-7d68-4245-906e-938122dae73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ca238-0799-49eb-b8ec-a246805fc65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ca238-0799-49eb-b8ec-a246805fc65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1853981066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9535a41d-c6b3-4a42-99dc-270dd1b8ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9e7d42b244e75a31d782e3933b721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:05Z,use_quota=True,user_id='556ad40e49e74d79a9dfad0d6bff3f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec03a813-b04c-4f7b-8f2f-be42aeab4ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec03a813-b04c-4f7b-8f2f-be42aeab4ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb010291-e79e-4b89-bc57-556934ddd195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb010291-e79e-4b89-bc57-556934ddd195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9535a41d-c6b3-4a42-99dc-270dd1b8ec7e', 'volume_name': 'volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b94557-070b-4bbc-9973-ed6609fce3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b94557-070b-4bbc-9973-ed6609fce3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a828e43-da25-4e67-a74a-709e13c40bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume 9535a41d-c6b3-4a42-99dc-270dd1b8ec7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e', 'volume_size': 1} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1853981066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9535a41d-c6b3-4a42-99dc-270dd1b8ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e9e7d42b244e75a31d782e3933b721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:05Z,use_quota=True,user_id='556ad40e49e74d79a9dfad0d6bff3f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Creating volume 9535a41d-c6b3-4a42-99dc-270dd1b8ec7e {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:05 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:05 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e 1073741824 Nov 05 08:30:05 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:05 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6" returned: 0 in 0.490s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:05 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6 Nov 05 08:30:05 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4febfa11-99ed-40fc-827b-62b610649bd6" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-4febfa11-99ed-40fc-827b-62b610649bd6" released by "delete_volume" :: held 0.925s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:06 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e 1073741824" returned: 0 in 0.634s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Created reservations ['7db21758-a0a5-482f-aa07-3e44d75dc348', 'd53bad67-067f-4244-b3e9-d9e10b1f3a61', 'e70626a1-2f09-442b-92b1-d43106197682', '976a6891-895c-40c3-b31c-0c0ccbf7caba'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:06 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e Nov 05 08:30:06 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:06 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:06 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-e3fe675c-aeb2-4c39-aa6a-6258313f35b7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "cinder-e3fe675c-aeb2-4c39-aa6a-6258313f35b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Acquiring lock "cinder-quobyte-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9eb25-621a-4726-87c2-02a9810ad9f4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:06 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a828e43-da25-4e67-a74a-709e13c40bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c98ea2-95bd-4b9f-84ac-e85b26b6fed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Volume volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e (9535a41d-c6b3-4a42-99dc-270dd1b8ec7e): created successfully Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c98ea2-95bd-4b9f-84ac-e85b26b6fed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:06 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 Nov 05 08:30:06 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Flow 'volume_create_manager' (2b324bf0-7d68-4245-906e-938122dae73e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d4b6041a-721f-4d83-b491-15e665797ff0 tempest-VolumeQuotasAdminTestJSON-1195330730 None] Created volume successfully. Nov 05 08:30:06 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.581s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:06 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-85c94982-a524-4f56-9560-ee479e24b02d tempest-VolumesGetTest-1289075865 None] Lock "cinder-4febfa11-99ed-40fc-827b-62b610649bd6-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:07 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" returned: 0 in 0.506s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:07 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7 Nov 05 08:30:07 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:07 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "cinder-quobyte-e3fe675c-aeb2-4c39-aa6a-6258313f35b7" released by "delete_volume" :: held 0.871s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Created reservations ['c046f25e-74b3-4767-980a-c65b64405d8b', 'f4d2b193-1ade-4019-904b-f4d472506dbe', 'dec42621-9625-4d16-92b8-19b945e75c10', '7ff91053-795d-484c-aa92-01120a1a8e96'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:07 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:07 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:08 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:08 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Deleted volume successfully. Nov 05 08:30:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6aebbdca-1e13-48fc-bfc9-6ad2496119b0 tempest-VolumesGetTest-1289075865 None] Lock "cinder-e3fe675c-aeb2-4c39-aa6a-6258313f35b7-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fa50ffd1-428c-4efe-a754-051abf4050ca tempest-VolumeQuotasAdminTestJSON-1543208618 None] Transfer volume completed successfully. Nov 05 08:30:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-a491b5d9-afde-4bd3-883f-e9f97cb91f00 req-05138126-8284-4f01-8add-959ae82b9c82 tempest-TestShelveInstance-826406077 None] Terminate volume connection completed successfully. Nov 05 08:30:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-a491b5d9-afde-4bd3-883f-e9f97cb91f00 req-05138126-8284-4f01-8add-959ae82b9c82 tempest-TestShelveInstance-826406077 None] Deleting attachment e78f4175-9838-4ce6-ad8d-7cb2f0b1598b. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Acquiring lock "cinder-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "cinder-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Acquiring lock "cinder-quobyte-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "cinder-quobyte-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8614a1f8-e874-4fb1-9beb-f7ce45852cf4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:10 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e Nov 05 08:30:10 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:10 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:11 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e Nov 05 08:30:11 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:11 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "cinder-quobyte-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e" released by "delete_volume" :: held 0.810s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Created reservations ['8fd6ec2c-28d2-49c9-9ae0-6bc5806df78d', '58de97a0-d632-4342-afa7-e1218da8ed20', '6ba84b24-0e45-4787-9248-ce29a9d84052', '5dafd878-6354-4ee0-b543-2f96643169e7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:11 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:11 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:11 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Deleted volume successfully. Nov 05 08:30:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bbcd4ddd-40ba-4c31-8704-779b931f4158 tempest-VolumeQuotasAdminTestJSON-705418697 None] Lock "cinder-9535a41d-c6b3-4a42-99dc-270dd1b8ec7e-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bce564dc-0d9c-455a-b26f-b1ee41f518d3 req-66944899-1d54-48b5-b2a0-e9cf85bcf4de tempest-TestShelveInstance-826406077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bce564dc-0d9c-455a-b26f-b1ee41f518d3 req-66944899-1d54-48b5-b2a0-e9cf85bcf4de tempest-TestShelveInstance-826406077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bce564dc-0d9c-455a-b26f-b1ee41f518d3 req-66944899-1d54-48b5-b2a0-e9cf85bcf4de tempest-TestShelveInstance-826406077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-bce564dc-0d9c-455a-b26f-b1ee41f518d3 req-66944899-1d54-48b5-b2a0-e9cf85bcf4de tempest-TestShelveInstance-826406077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-6e12f203-855f-40e3-81b2-638f40301c7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fbb3857-58a3-4ebc-a62d-2a8d1368bbef', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:30:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-bce564dc-0d9c-455a-b26f-b1ee41f518d3 req-66944899-1d54-48b5-b2a0-e9cf85bcf4de tempest-TestShelveInstance-826406077 None] attachment_update completed successfully. Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Flow 'volume_create_manager' (06e8d76c-512c-42c9-8b43-8a4c326b8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b4b2e-9b2e-463a-983f-2e9309d7910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b4b2e-9b2e-463a-983f-2e9309d7910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-530683459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc163ea7-d4c7-424e-895a-ae591b95d02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315119e7bcd446d9a4322ab5de6dd7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:16Z,use_quota=True,user_id='b483da49c9854b3ca01d871498a7b1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f554648e-e046-41fb-9845-2dcf48a4642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f554648e-e046-41fb-9845-2dcf48a4642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8e1b15-f694-489e-8537-d12b005a60cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8e1b15-f694-489e-8537-d12b005a60cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc163ea7-d4c7-424e-895a-ae591b95d02c', 'volume_name': 'volume-fc163ea7-d4c7-424e-895a-ae591b95d02c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7128e57-b62b-4745-9c26-ca31746c02d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7128e57-b62b-4745-9c26-ca31746c02d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185852fc-d21d-42c4-8d13-ded7e0a3a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:15 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Volume fc163ea7-d4c7-424e-895a-ae591b95d02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc163ea7-d4c7-424e-895a-ae591b95d02c', 'volume_size': 1} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-530683459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc163ea7-d4c7-424e-895a-ae591b95d02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='315119e7bcd446d9a4322ab5de6dd7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:16Z,use_quota=True,user_id='b483da49c9854b3ca01d871498a7b1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Creating volume fc163ea7-d4c7-424e-895a-ae591b95d02c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:15 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:15 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c 1073741824 Nov 05 08:30:15 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:16 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c 1073741824" returned: 0 in 0.703s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:16 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c Nov 05 08:30:16 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:16 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185852fc-d21d-42c4-8d13-ded7e0a3a263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc163ea7-d4c7-424e-895a-ae591b95d02c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f963b1-bd21-4615-95a3-65fba3531b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Volume volume-fc163ea7-d4c7-424e-895a-ae591b95d02c (fc163ea7-d4c7-424e-895a-ae591b95d02c): created successfully Nov 05 08:30:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f963b1-bd21-4615-95a3-65fba3531b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Flow 'volume_create_manager' (06e8d76c-512c-42c9-8b43-8a4c326b8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6f3c8be5-1b28-4c66-93e3-f28eb3d44f4d tempest-VolumesNegativeTest-1516599920 None] Created volume successfully. Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:18 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:18 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:18 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:30:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:30:27 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=111,cinder:SELECT=85,cinder:DELETE=10,cinder:INSERT=30 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:30:27 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=112,cinder:INSERT=35,cinder:SELECT=91,cinder:DELETE=8 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Acquiring lock "cinder-fc163ea7-d4c7-424e-895a-ae591b95d02c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "cinder-fc163ea7-d4c7-424e-895a-ae591b95d02c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Acquiring lock "cinder-quobyte-fc163ea7-d4c7-424e-895a-ae591b95d02c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "cinder-quobyte-fc163ea7-d4c7-424e-895a-ae591b95d02c" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be57c6-6c5f-46f8-9edb-802deee7e230]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c Nov 05 08:30:48 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:48 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c" returned: 0 in 0.543s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:48 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c Nov 05 08:30:48 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:49 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fc163ea7-d4c7-424e-895a-ae591b95d02c" returned: 0 in 0.307s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "cinder-quobyte-fc163ea7-d4c7-424e-895a-ae591b95d02c" released by "delete_volume" :: held 0.990s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Created reservations ['0f07b0c6-8476-4620-9d68-bf153d2524a0', 'ccd104ec-bb80-4c3f-bfa7-348b3b6416ad', '461a1359-cf51-4c67-b6e6-4968c217c8fa', '66f211d1-dca0-44dc-b5f7-6f00829921f7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:49 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:30:49 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:49 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:30:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Deleted volume successfully. Nov 05 08:30:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e3f4e93-97d7-4e5b-a9e1-a9c962f1e76e tempest-VolumesNegativeTest-1516599920 None] Lock "cinder-fc163ea7-d4c7-424e-895a-ae591b95d02c-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (5276feba-fb61-4ca4-b35d-154ae67fff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa3ad63-0163-4c83-9865-96a5dbc8ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa3ad63-0163-4c83-9865-96a5dbc8ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1714400595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec1547-880e-4579-8f8e-e3d7612089ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:57Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231faed9-52c1-40e9-ac53-b94a413c91df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231faed9-52c1-40e9-ac53-b94a413c91df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee5dc2c-a77c-4fc8-8953-289f4c28c946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee5dc2c-a77c-4fc8-8953-289f4c28c946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ec1547-880e-4579-8f8e-e3d7612089ea', 'volume_name': 'volume-a7ec1547-880e-4579-8f8e-e3d7612089ea', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54905d99-e3ee-4bee-a512-77a703277849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54905d99-e3ee-4bee-a512-77a703277849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054bccad-1a0c-4c0b-85ba-048e41a2392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Volume a7ec1547-880e-4579-8f8e-e3d7612089ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ec1547-880e-4579-8f8e-e3d7612089ea', 'volume_size': 1} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1714400595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ec1547-880e-4579-8f8e-e3d7612089ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:30:57Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Creating volume a7ec1547-880e-4579-8f8e-e3d7612089ea {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:30:57 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:30:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:57 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea 1073741824 Nov 05 08:30:57 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:58 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea 1073741824" returned: 0 in 0.601s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:30:58 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea Nov 05 08:30:58 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:30:58 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054bccad-1a0c-4c0b-85ba-048e41a2392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ec1547-880e-4579-8f8e-e3d7612089ea', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088458d5-b042-4e98-ae27-aabbe6fce889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:30:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Volume volume-a7ec1547-880e-4579-8f8e-e3d7612089ea (a7ec1547-880e-4579-8f8e-e3d7612089ea): created successfully Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088458d5-b042-4e98-ae27-aabbe6fce889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:30:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (5276feba-fb61-4ca4-b35d-154ae67fff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:30:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-34d5b6d9-d544-4767-a19c-0df32ef555b5 tempest-VolumesListAdminTestJSON-1745609397 None] Created volume successfully. Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (536c33e0-1b9c-44c0-81be-4b6fdcff4273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae95caf3-3c69-4618-ba27-48876e792796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae95caf3-3c69-4618-ba27-48876e792796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1995210110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5472f3-7c8b-4eab-9699-d30867327c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:00Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7647be36-7f92-4801-ba6c-7e9594db2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7647be36-7f92-4801-ba6c-7e9594db2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2864ab-d01c-48b6-a6cb-7d79c7f490f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2864ab-d01c-48b6-a6cb-7d79c7f490f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5472f3-7c8b-4eab-9699-d30867327c64', 'volume_name': 'volume-0b5472f3-7c8b-4eab-9699-d30867327c64', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee04940-d9b5-48a8-9d29-9a68e8a482d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee04940-d9b5-48a8-9d29-9a68e8a482d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eade48-fa62-4087-9655-5ae6a7281099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Volume 0b5472f3-7c8b-4eab-9699-d30867327c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5472f3-7c8b-4eab-9699-d30867327c64', 'volume_size': 1} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1995210110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5472f3-7c8b-4eab-9699-d30867327c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:00Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Creating volume 0b5472f3-7c8b-4eab-9699-d30867327c64 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:00 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 1073741824 Nov 05 08:31:00 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:00 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 1073741824" returned: 0 in 0.599s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:01 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 Nov 05 08:31:01 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:01 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eade48-fa62-4087-9655-5ae6a7281099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5472f3-7c8b-4eab-9699-d30867327c64', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b774ef-5347-4385-889d-17ad15393488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Volume volume-0b5472f3-7c8b-4eab-9699-d30867327c64 (0b5472f3-7c8b-4eab-9699-d30867327c64): created successfully Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b774ef-5347-4385-889d-17ad15393488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (536c33e0-1b9c-44c0-81be-4b6fdcff4273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fc0bd03e-3c92-47db-85fb-6a48a1dcd243 tempest-VolumesListAdminTestJSON-1745609397 None] Created volume successfully. Nov 05 08:31:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (ec71d950-2ed9-4927-9649-5d32ba81b360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b4f22-8dce-45f0-b5cb-ae429bc5813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436b4f22-8dce-45f0-b5cb-ae429bc5813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-793361225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e7d726-e205-4eb8-85b0-d44ea606ab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:03Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6092d47-b581-4a7c-bff1-d76e7e716986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6092d47-b581-4a7c-bff1-d76e7e716986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90dabe-7d35-4e76-b3e3-cccf214454a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90dabe-7d35-4e76-b3e3-cccf214454a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e7d726-e205-4eb8-85b0-d44ea606ab99', 'volume_name': 'volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e17678e-1403-488c-9a5c-1618b8e04895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e17678e-1403-488c-9a5c-1618b8e04895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a20c1-f50d-4c40-ae80-336fdf379fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Volume f2e7d726-e205-4eb8-85b0-d44ea606ab99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99', 'volume_size': 1} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-793361225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e7d726-e205-4eb8-85b0-d44ea606ab99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0786f5296b34f1a9417ad705cd41b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:03Z,use_quota=True,user_id='f8e831cffe554e29bd1551334737883c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Creating volume f2e7d726-e205-4eb8-85b0-d44ea606ab99 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:03 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 1073741824 Nov 05 08:31:03 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:03 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 1073741824" returned: 0 in 0.773s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:04 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 Nov 05 08:31:04 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:04 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99" returned: 0 in 0.556s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a20c1-f50d-4c40-ae80-336fdf379fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f11bf9-ca18-4496-a8da-96e55a91d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Volume volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 (f2e7d726-e205-4eb8-85b0-d44ea606ab99): created successfully Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f11bf9-ca18-4496-a8da-96e55a91d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Flow 'volume_create_manager' (ec71d950-2ed9-4927-9649-5d32ba81b360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8190b2d0-8589-4f51-9c3b-50b00936e538 tempest-VolumesListAdminTestJSON-1745609397 None] Created volume successfully. Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Flow 'volume_create_manager' (1b19473d-449c-4f9d-9cae-42aaa2f994b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5e32bf-c5c9-4f33-b3b0-afdf4c7274d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5e32bf-c5c9-4f33-b3b0-afdf4c7274d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49f29a3-85a5-4612-a21a-f84d0b57c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79394ed716484ab854ac899140cacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:06Z,use_quota=True,user_id='6aa4452876da491ca3911243393c9f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4967574c-19b5-47e7-be41-937077ebd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4967574c-19b5-47e7-be41-937077ebd32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94821fe-b6c1-4703-a1b1-7ec5d6e9b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94821fe-b6c1-4703-a1b1-7ec5d6e9b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49f29a3-85a5-4612-a21a-f84d0b57c143', 'volume_name': 'volume-f49f29a3-85a5-4612-a21a-f84d0b57c143', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3867dae-a6d6-4880-9718-f43bec5392e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3867dae-a6d6-4880-9718-f43bec5392e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f3c072-907a-4475-81cb-d4eb65373bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Volume f49f29a3-85a5-4612-a21a-f84d0b57c143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49f29a3-85a5-4612-a21a-f84d0b57c143', 'volume_size': 1} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f49f29a3-85a5-4612-a21a-f84d0b57c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79394ed716484ab854ac899140cacc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:06Z,use_quota=True,user_id='6aa4452876da491ca3911243393c9f69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Creating volume f49f29a3-85a5-4612-a21a-f84d0b57c143 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-6aebf846-13fe-48cc-ad42-e21de32445cc tempest-TestShelveInstance-826406077 None] Terminate volume connection completed successfully. Nov 05 08:31:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-6aebf846-13fe-48cc-ad42-e21de32445cc tempest-TestShelveInstance-826406077 None] Deleting attachment 8fbb3857-58a3-4ebc-a62d-2a8d1368bbef. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:31:06 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 1073741824 Nov 05 08:31:06 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Acquiring lock "cinder-6e12f203-855f-40e3-81b2-638f40301c7c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "cinder-6e12f203-855f-40e3-81b2-638f40301c7c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Acquiring lock "cinder-quobyte-6e12f203-855f-40e3-81b2-638f40301c7c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "cinder-quobyte-6e12f203-855f-40e3-81b2-638f40301c7c" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9bd5c6-46dc-4611-8e29-fc5bbb203850]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:07 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 1073741824" returned: 0 in 1.037s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (dc0ded18-466c-4de8-a77b-6e11d630aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e481a231-bdf3-4a4b-bfa9-f491dc992623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e481a231-bdf3-4a4b-bfa9-f491dc992623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1238480066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825366f-2f43-458f-9d0a-01f8457634c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:08Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e021bf-1af2-40dd-bd18-421d5522416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:07 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 Nov 05 08:31:07 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e021bf-1af2-40dd-bd18-421d5522416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da299662-b8d7-4112-a24f-48e261c59157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da299662-b8d7-4112-a24f-48e261c59157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6825366f-2f43-458f-9d0a-01f8457634c5', 'volume_name': 'volume-6825366f-2f43-458f-9d0a-01f8457634c5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4fcf42-98aa-47a3-857a-915bafa053cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4fcf42-98aa-47a3-857a-915bafa053cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a3128a-6140-474e-8ebb-7670ab085715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume 6825366f-2f43-458f-9d0a-01f8457634c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6825366f-2f43-458f-9d0a-01f8457634c5', 'volume_size': 1} Nov 05 08:31:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:07 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c Nov 05 08:31:07 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:08 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143" returned: 0 in 0.692s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1238480066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825366f-2f43-458f-9d0a-01f8457634c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:08Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Creating volume 6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:08 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 1073741824 Nov 05 08:31:08 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f3c072-907a-4475-81cb-d4eb65373bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49f29a3-85a5-4612-a21a-f84d0b57c143', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84ac132-abe6-4a2a-bc39-fbdab02a31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Volume volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 (f49f29a3-85a5-4612-a21a-f84d0b57c143): created successfully Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84ac132-abe6-4a2a-bc39-fbdab02a31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Flow 'volume_create_manager' (1b19473d-449c-4f9d-9cae-42aaa2f994b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-39fc307c-1e41-4397-b892-edd7f325dcde tempest-VolumesListAdminTestJSON-152921220 None] Created volume successfully. Nov 05 08:31:08 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c" returned: 0 in 1.225s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:08 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c Nov 05 08:31:08 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:09 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6e12f203-855f-40e3-81b2-638f40301c7c" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "cinder-quobyte-6e12f203-855f-40e3-81b2-638f40301c7c" released by "delete_volume" :: held 1.750s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.quota [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Created reservations ['c3429499-95b4-4fd2-af8a-fb06e0fd4dfd', 'c303bbc0-8ae9-43bd-9a6f-473f8a16c1f0', '7b69cd48-a09a-4384-a8b2-327a9b0d0089', 'e45488e3-3402-49bf-a5d1-9c568a7e3b50'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:09 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 1073741824" returned: 0 in 0.910s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:09 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:09 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:09 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 Nov 05 08:31:09 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:09 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:09 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:09 devstack cinder-volume[87092]: DEBUG cinder.manager [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Deleted volume successfully. Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Acquiring lock "cinder-f49f29a3-85a5-4612-a21a-f84d0b57c143-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a3128a-6140-474e-8ebb-7670ab085715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6825366f-2f43-458f-9d0a-01f8457634c5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80960725-ac9a-4041-bc9b-8645047615a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "cinder-f49f29a3-85a5-4612-a21a-f84d0b57c143-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume volume-6825366f-2f43-458f-9d0a-01f8457634c5 (6825366f-2f43-458f-9d0a-01f8457634c5): created successfully Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80960725-ac9a-4041-bc9b-8645047615a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (dc0ded18-466c-4de8-a77b-6e11d630aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [req-9e2eabc1-f4ff-45fc-a467-3c6e5b21d6a9 req-ca54e33e-93e8-4b3d-aac6-439214f1e949 tempest-TestShelveInstance-826406077 None] Lock "cinder-6e12f203-855f-40e3-81b2-638f40301c7c-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e21a6618-471a-4169-b68e-a2b9fd7bc0bc tempest-VolumesSnapshotTestJSON-1364459749 None] Created volume successfully. Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Acquiring lock "cinder-quobyte-f49f29a3-85a5-4612-a21a-f84d0b57c143" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-f2e7d726-e205-4eb8-85b0-d44ea606ab99-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "cinder-quobyte-f49f29a3-85a5-4612-a21a-f84d0b57c143" acquired by "delete_volume" :: waited 0.063s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573bb01-fe5a-4ea6-a504-770b66b2cb2a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-f2e7d726-e205-4eb8-85b0-d44ea606ab99-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-quobyte-f2e7d726-e205-4eb8-85b0-d44ea606ab99" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:10 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 Nov 05 08:31:10 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-f2e7d726-e205-4eb8-85b0-d44ea606ab99" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabbfdf3-9936-41b4-8720-77d932fafc25]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:11 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 Nov 05 08:31:11 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (1b203453-530a-4b0a-ac62-3b7d80ecc80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e15057-d240-42e8-825c-211d656a188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:11 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e15057-d240-42e8-825c-211d656a188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-331170629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b70fb-bf6b-4e55-9c18-aa6d6f0b5290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:11Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7970285b-61d8-4fde-8ef9-fc1224dcd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7970285b-61d8-4fde-8ef9-fc1224dcd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d151a3-ccd1-476e-9d88-e47dc787ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d151a3-ccd1-476e-9d88-e47dc787ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421b70fb-bf6b-4e55-9c18-aa6d6f0b5290', 'volume_name': 'volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5e2bf2-149b-4d38-a6ed-9f27d01a349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5e2bf2-149b-4d38-a6ed-9f27d01a349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc2bdf0-de12-4b0e-926b-8c5ae2245153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Volume 421b70fb-bf6b-4e55-9c18-aa6d6f0b5290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290', 'volume_size': 1} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-331170629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b70fb-bf6b-4e55-9c18-aa6d6f0b5290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:11Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Creating volume 421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:11 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143" returned: 0 in 1.102s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:11 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 1073741824 Nov 05 08:31:11 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:11 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143 Nov 05 08:31:11 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:11 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99" returned: 0 in 0.881s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:11 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99 Nov 05 08:31:11 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:12 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f49f29a3-85a5-4612-a21a-f84d0b57c143" returned: 0 in 0.642s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "cinder-quobyte-f49f29a3-85a5-4612-a21a-f84d0b57c143" released by "delete_volume" :: held 1.864s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:12 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e7d726-e205-4eb8-85b0-d44ea606ab99" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-f2e7d726-e205-4eb8-85b0-d44ea606ab99" released by "delete_volume" :: held 1.534s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:12 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 1073741824" returned: 0 in 0.776s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Created reservations ['bbaed919-a271-4977-b1a7-68d8cc476bcb', 'da0b5ee4-d162-453d-bad8-23e20a44880c', 'dd9c80c1-7e8b-42b6-ab84-fc282ad04d6c', '4f6d8d90-52cf-434a-bff1-a7bce56e3c0c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:12 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 Nov 05 08:31:12 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Created reservations ['668fe138-bbc8-4cc9-a1c1-61d24c4d5067', 'b402615f-42f2-4c54-b5ab-11bed241f292', '1612f1a8-59e1-42bd-b34d-5630785ae5e0', '6f2af53c-8913-47d1-8986-6b00d708a607'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:12 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:12 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:12 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:12 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:12 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:12 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-0b5472f3-7c8b-4eab-9699-d30867327c64-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Deleted volume successfully. Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc2bdf0-de12-4b0e-926b-8c5ae2245153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3a39ac-2eab-4700-90df-5c355c26c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:13 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Creating offline snapshot 1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 of volume 6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[df134b72-a7f1-4f31-857f-a1cf234e5f25]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-0b5472f3-7c8b-4eab-9699-d30867327c64-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Deleted volume successfully. Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15384a2d-547c-46b7-a2b4-3fd21722bf78 tempest-VolumesListAdminTestJSON-152921220 None] Lock "cinder-f49f29a3-85a5-4612-a21a-f84d0b57c143-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Volume volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 (421b70fb-bf6b-4e55-9c18-aa6d6f0b5290): created successfully Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3a39ac-2eab-4700-90df-5c355c26c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (1b203453-530a-4b0a-ac62-3b7d80ecc80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-50cf9a04-752a-42de-b1c2-35b257121c89 tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:13 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 Nov 05 08:31:13 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-56e0994d-9bf1-4c9d-829f-53b1a571f775 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-f2e7d726-e205-4eb8-85b0-d44ea606ab99-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-quobyte-0b5472f3-7c8b-4eab-9699-d30867327c64" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-0b5472f3-7c8b-4eab-9699-d30867327c64" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2006cfd-705e-4b6a-9486-dc299bf5ed6f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 Nov 05 08:31:13 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5" returned: 0 in 0.569s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:13 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 1G Nov 05 08:31:13 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:13 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64" returned: 0 in 0.515s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:14 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64 Nov 05 08:31:14 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21645073-f55f-4a4d-992f-b3b704325ce7 tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21645073-f55f-4a4d-992f-b3b704325ce7 tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" acquired by "attach_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21645073-f55f-4a4d-992f-b3b704325ce7 tempest-VolumesActionsTest-340709335 None] Attaching volume 421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 to instance f2daba49-bf4b-47d8-ac05-1ea58b71d971 at mountpoint /dev/vdb on host None. Nov 05 08:31:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21645073-f55f-4a4d-992f-b3b704325ce7 tempest-VolumesActionsTest-340709335 None] Attach volume completed successfully. Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-21645073-f55f-4a4d-992f-b3b704325ce7 tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" released by "attach_volume" :: held 0.182s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:14 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0b5472f3-7c8b-4eab-9699-d30867327c64" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:14 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 1G" returned: 0 in 0.779s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825366f-2f43-458f-9d0a-01f8457634c5 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-0b5472f3-7c8b-4eab-9699-d30867327c64" released by "delete_volume" :: held 1.131s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:14 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825366f-2f43-458f-9d0a-01f8457634c5 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 Nov 05 08:31:14 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Created reservations ['e7f87be1-ab26-4a42-be38-8df8c6d35449', '64f14fcc-c9f5-4a2f-b0bc-989b8851b402', 'ca335c27-e8f3-4e90-bbcd-0f996a47a037', 'c88d0729-3e66-46fc-afd6-2c125dd9ce2e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:14 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:14 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:15 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825366f-2f43-458f-9d0a-01f8457634c5 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" returned: 0 in 0.539s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 is being set with open permissions: ugo+rw Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:15 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 Nov 05 08:31:15 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:15 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Deleted volume successfully. Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-faea4c2f-9961-4cd2-9d6f-2a3c8557728e tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-0b5472f3-7c8b-4eab-9699-d30867327c64-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:15 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Terminate volume connection completed successfully. Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:15 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info Nov 05 08:31:15 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-a7ec1547-880e-4579-8f8e-e3d7612089ea-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-a7ec1547-880e-4579-8f8e-e3d7612089ea-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Detaching volume 421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 from instance f2daba49-bf4b-47d8-ac05-1ea58b71d971. Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "cinder-quobyte-a7ec1547-880e-4579-8f8e-e3d7612089ea" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-a7ec1547-880e-4579-8f8e-e3d7612089ea" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bcf94b-b2c0-49b3-82d3-adaf39f61d5d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Detach volume completed successfully. Nov 05 08:31:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-10f494bf-f9d4-4405-9509-550f79bc2c5b tempest-VolumesActionsTest-210716267 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" released by "detach_volume" :: held 0.158s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:16 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea Nov 05 08:31:16 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info is being set with open permissions: ugo+rw Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info Nov 05 08:31:16 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8d092ea2-a910-4d41-a003-108998c5552f tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8d092ea2-a910-4d41-a003-108998c5552f tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8d092ea2-a910-4d41-a003-108998c5552f tempest-VolumesActionsTest-340709335 None] Volume detach called, but volume not attached. Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8d092ea2-a910-4d41-a003-108998c5552f tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:16 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea Nov 05 08:31:16 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:16 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.info" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.598s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-quobyte-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "cinder-quobyte-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" acquired by "delete_volume" :: waited 0.060s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7f4dc010-bcd9-4a5d-88ac-7a6d6a1351e2 tempest-VolumesSnapshotTestJSON-1364459749 None] Create snapshot completed successfully Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a926d-0b06-4006-9fdb-9d964387c024]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:16 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a7ec1547-880e-4579-8f8e-e3d7612089ea" returned: 0 in 0.632s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-quobyte-a7ec1547-880e-4579-8f8e-e3d7612089ea" released by "delete_volume" :: held 1.117s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Created reservations ['2694f173-c192-49e6-b29c-de8919d1e654', '1f746b03-85e7-4a15-a89c-d1befc815246', 'dd3790cd-cd43-4d24-b294-17c0d80c7330', '22268eab-ca71-4c04-851d-3ca3a9ade635'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:17 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 Nov 05 08:31:17 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:17 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:17 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:17 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Deleted volume successfully. Nov 05 08:31:17 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d0b80ba9-0a10-4a05-974e-b0b3a1552e62 tempest-VolumesListAdminTestJSON-1745609397 None] Lock "cinder-a7ec1547-880e-4579-8f8e-e3d7612089ea-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290 Nov 05 08:31:17 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:17 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "cinder-quobyte-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290" released by "delete_volume" :: held 1.087s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Created reservations ['67511c28-913e-4a33-892f-73daa5f67152', '6c4a2e6b-f6ae-4eef-8cbb-f81b43e78ccb', '159746cf-f9e3-42d2-bcfa-e681f5785a00', '9552c2e3-e36b-4abc-a8bf-7bfa480094c2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:18 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:18 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:18 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:18 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Deleting offline snapshot 1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 of volume 6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] snapshot_file for this snap is: volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[697965b1-2ef0-4067-aac5-5174ff40ae19]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:18 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:18 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:18 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Deleted volume successfully. Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1f729cbe-d8f7-46f2-9094-5a01f495f33d tempest-VolumesActionsTest-340709335 None] Lock "cinder-421b70fb-bf6b-4e55-9c18-aa6d6f0b5290-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:18 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.617s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:31:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:31:19 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" returned: 0 in 0.596s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825366f-2f43-458f-9d0a-01f8457634c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a48b37-c11a-4182-b2ab-fbc8b8de1c14]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:19 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 Nov 05 08:31:19 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:19 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5" returned: 0 in 0.711s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:19 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 Nov 05 08:31:19 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:20 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:20 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01 Nov 05 08:31:20 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:20 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5.1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01" released by "_delete_snapshot" :: held 2.384s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" released by "delete_snapshot" :: held 2.437s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['974741c6-c709-4e23-9e49-b8a735d24643', 'ee025a33-3929-4763-87d9-8ffebadcaf2c', '4d33d202-9dd3-41eb-a546-d29046d0cac6', 'b491f37c-e32c-4004-a776-3d73321454e4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Delete snapshot completed successfully. Nov 05 08:31:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6888a056-2e33-4859-95e3-1e94e2c2d186 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-1a04d31c-4c10-4879-b3b8-91b1d0c8ac01-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (d8479914-94af-464b-b44e-27f4690e4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a850d29c-9863-4c24-8a0d-4f827f787cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a850d29c-9863-4c24-8a0d-4f827f787cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029398619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048978aa-b7ac-435a-b647-cba0a676a033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:22Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d915bec-3f32-46c9-b18d-e4286e970f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d915bec-3f32-46c9-b18d-e4286e970f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b94b72-a768-4388-9d06-3c84a392b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b94b72-a768-4388-9d06-3c84a392b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048978aa-b7ac-435a-b647-cba0a676a033', 'volume_name': 'volume-048978aa-b7ac-435a-b647-cba0a676a033', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1056701-e5cf-47d1-9e62-1d924a063197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1056701-e5cf-47d1-9e62-1d924a063197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87174eec-9ce8-4224-bee2-3586d33ada89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Volume 048978aa-b7ac-435a-b647-cba0a676a033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048978aa-b7ac-435a-b647-cba0a676a033', 'volume_size': 1} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029398619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048978aa-b7ac-435a-b647-cba0a676a033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:22Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Creating volume 048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:22 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 1073741824 Nov 05 08:31:22 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:22 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 1073741824" returned: 0 in 0.571s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:22 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:22 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:23 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (056aefba-ba87-4983-9360-07a83da32224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e97330-960b-4173-a7cd-b514c6f223d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e97330-960b-4173-a7cd-b514c6f223d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1198435336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8470e3d7-014d-4b08-bd26-2220585f1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:23Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca40190e-e8f5-4cf9-a7bf-b9a248b5e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca40190e-e8f5-4cf9-a7bf-b9a248b5e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dacc1d-996f-4185-b774-3a5572d773f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dacc1d-996f-4185-b774-3a5572d773f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8470e3d7-014d-4b08-bd26-2220585f1ee3', 'volume_name': 'volume-8470e3d7-014d-4b08-bd26-2220585f1ee3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d280d3-dc2e-4673-a6d4-af5cf0aec2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d280d3-dc2e-4673-a6d4-af5cf0aec2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7fe789-a7b5-4dd0-be27-0594629d14eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Volume 8470e3d7-014d-4b08-bd26-2220585f1ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8470e3d7-014d-4b08-bd26-2220585f1ee3', 'volume_size': 1} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1198435336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8470e3d7-014d-4b08-bd26-2220585f1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:23Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Creating volume 8470e3d7-014d-4b08-bd26-2220585f1ee3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87174eec-9ce8-4224-bee2-3586d33ada89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048978aa-b7ac-435a-b647-cba0a676a033', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a4ced1-c653-4bfb-a727-2f585b3539eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:23 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 1073741824 Nov 05 08:31:23 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Volume volume-048978aa-b7ac-435a-b647-cba0a676a033 (048978aa-b7ac-435a-b647-cba0a676a033): created successfully Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a4ced1-c653-4bfb-a727-2f585b3539eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (d8479914-94af-464b-b44e-27f4690e4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-92af2b04-1db8-42fd-b6ee-7ea71f9251bf tempest-VolumesSnapshotTestJSON-1364459749 None] Created volume successfully. Nov 05 08:31:23 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 1073741824" returned: 0 in 0.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:23 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 Nov 05 08:31:23 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7fe789-a7b5-4dd0-be27-0594629d14eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8470e3d7-014d-4b08-bd26-2220585f1ee3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec55b9d-0232-43c4-927c-5636e4f56b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Volume volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 (8470e3d7-014d-4b08-bd26-2220585f1ee3): created successfully Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec55b9d-0232-43c4-927c-5636e4f56b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (056aefba-ba87-4983-9360-07a83da32224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-66619e6c-8365-42c7-b829-c2abf8c4f15f tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Creating offline snapshot 4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 of volume 048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2fe30-7d92-4404-b5e8-4d543e74b865]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:24 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:24 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:24 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:24 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 1G Nov 05 08:31:24 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-8470e3d7-014d-4b08-bd26-2220585f1ee3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "cinder-8470e3d7-014d-4b08-bd26-2220585f1ee3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:25 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 1G" returned: 0 in 0.648s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048978aa-b7ac-435a-b647-cba0a676a033 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-quobyte-8470e3d7-014d-4b08-bd26-2220585f1ee3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:25 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048978aa-b7ac-435a-b647-cba0a676a033 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:25 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-8470e3d7-014d-4b08-bd26-2220585f1ee3" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dc556-6db7-4fcc-8d62-68495865fe9b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:25 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 Nov 05 08:31:25 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:25 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048978aa-b7ac-435a-b647-cba0a676a033 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 is being set with open permissions: ugo+rw Nov 05 08:31:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:25 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:25 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3 Nov 05 08:31:26 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.364s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info Nov 05 08:31:26 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-8470e3d7-014d-4b08-bd26-2220585f1ee3" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-8470e3d7-014d-4b08-bd26-2220585f1ee3" released by "delete_volume" :: held 0.842s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Created reservations ['416eb8a7-f72b-4e9e-b583-d2a54e726ea9', '741aca3a-098e-408b-9bd9-dcf067715f19', 'cbafa67e-900a-468e-8d15-edbc46cdbc10', 'f6c9fe30-3d70-4352-ad19-9e4f70891479'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:26 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:26 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:26 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info is being set with open permissions: ugo+rw Nov 05 08:31:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:26 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info Nov 05 08:31:26 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:27 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Deleted volume successfully. Nov 05 08:31:27 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.info" returned: 0 in 0.383s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-60fd063d-29cf-4fab-833f-4b54abb40a6e tempest-VolumesSnapshotTestJSON-1364459749 None] Create snapshot completed successfully Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c6ab3e89-4099-4326-a3cf-fea12ec93d5d tempest-VolumesActionsTest-210716267 None] Lock "cinder-8470e3d7-014d-4b08-bd26-2220585f1ee3-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (1fd90f1c-0e46-4c20-a1b5-5ec2d394b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d177f02-53a5-495a-8f70-368f6c7c90c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d177f02-53a5-495a-8f70-368f6c7c90c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996890736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499b5769-b602-4cf3-9e50-6d497af97e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:27Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0974faac-18a6-42cd-9b00-a2033207ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0974faac-18a6-42cd-9b00-a2033207ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9d2ae5-13cf-4561-8031-75c6900f8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9d2ae5-13cf-4561-8031-75c6900f8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499b5769-b602-4cf3-9e50-6d497af97e51', 'volume_name': 'volume-499b5769-b602-4cf3-9e50-6d497af97e51', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53ca218-c0ef-4029-895a-08afd5be9376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53ca218-c0ef-4029-895a-08afd5be9376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40c3aac-e8cd-4a08-addf-d659781c5d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Volume 499b5769-b602-4cf3-9e50-6d497af97e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499b5769-b602-4cf3-9e50-6d497af97e51', 'volume_size': 1} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996890736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499b5769-b602-4cf3-9e50-6d497af97e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:27Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Creating volume 499b5769-b602-4cf3-9e50-6d497af97e51 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:27 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 1073741824 Nov 05 08:31:27 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:28 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 1073741824" returned: 0 in 0.631s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:28 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 Nov 05 08:31:28 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (285d783b-a1f6-4105-b1c5-f2ba4aec9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cd346f-3291-47fe-ae79-afb8fa677754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cd346f-3291-47fe-ae79-afb8fa677754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-172534820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0eba2d6-083e-453e-be36-46cf90b71aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4fc93c20-31aa-4319-9f81-dc6c0d6d4e40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:28Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c72a4d5-f744-4d52-a962-d062aa6956b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c72a4d5-f744-4d52-a962-d062aa6956b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1c2971-dd82-435d-b7b7-c5c33668244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1c2971-dd82-435d-b7b7-c5c33668244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0eba2d6-083e-453e-be36-46cf90b71aa3', 'volume_name': 'volume-b0eba2d6-083e-453e-be36-46cf90b71aa3', 'volume_size': 2, 'snapshot_id': '4fc93c20-31aa-4319-9f81-dc6c0d6d4e40'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd22303-db13-4be0-892c-f13e1c937508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd22303-db13-4be0-892c-f13e1c937508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd50158-f9ca-4312-9df8-bf1483782721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume b0eba2d6-083e-453e-be36-46cf90b71aa3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0eba2d6-083e-453e-be36-46cf90b71aa3', 'volume_size': 2, 'snapshot_id': '4fc93c20-31aa-4319-9f81-dc6c0d6d4e40'} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:28 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.160s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-b0eba2d6-083e-453e-be36-46cf90b71aa3" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40c3aac-e8cd-4a08-addf-d659781c5d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499b5769-b602-4cf3-9e50-6d497af97e51', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54770304-815e-4417-b1fa-f1dfc259db69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-b0eba2d6-083e-453e-be36-46cf90b71aa3" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Creating volume b0eba2d6-083e-453e-be36-46cf90b71aa3 from snapshot 4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Volume volume-499b5769-b602-4cf3-9e50-6d497af97e51 (499b5769-b602-4cf3-9e50-6d497af97e51): created successfully Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54770304-815e-4417-b1fa-f1dfc259db69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (1fd90f1c-0e46-4c20-a1b5-5ec2d394b58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] snapshot: 4fc93c20-31aa-4319-9f81-dc6c0d6d4e40, volume: b0eba2d6-083e-453e-be36-46cf90b71aa3, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Flow 'volume_create_manager' (f49368a7-fca5-4dee-87c2-1068c8055400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b842e892-d72d-4522-9836-283df952710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e57e1bd3-ef2f-4e77-9bec-bc9f696dc379 tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b842e892-d72d-4522-9836-283df952710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1120185455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc53bb4-cbd2-4dce-880e-af9be5afdeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbae4edbf14c416e8d84e765f8d418b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:29Z,use_quota=True,user_id='d0a8e205c224417699651a9360b9149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5cebe-55d2-4941-9882-894bd889b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a5cebe-55d2-4941-9882-894bd889b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db2e9d-3d3a-480a-b677-e93469e0124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21db2e9d-3d3a-480a-b677-e93469e0124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc53bb4-cbd2-4dce-880e-af9be5afdeb7', 'volume_name': 'volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290e06a8-fc67-4a3b-9af1-dce11434d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290e06a8-fc67-4a3b-9af1-dce11434d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6848b3aa-e031-44bb-9954-0c01a898801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Volume 7fc53bb4-cbd2-4dce-880e-af9be5afdeb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7', 'volume_size': 1} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3229a06-6d00-40ef-9c5a-3391421b6dc9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:29 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:29 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:29 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048978aa-b7ac-435a-b647-cba0a676a033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a604c60c-a678-4111-8bb6-44cda572d0d8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:29 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:29 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-499b5769-b602-4cf3-9e50-6d497af97e51-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "cinder-499b5769-b602-4cf3-9e50-6d497af97e51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:29 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:29 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 Nov 05 08:31:29 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-quobyte-499b5769-b602-4cf3-9e50-6d497af97e51" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-499b5769-b602-4cf3-9e50-6d497af97e51" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8d806-a5a5-467d-9366-17a99cf2ba02]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:30 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 Nov 05 08:31:30 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:30 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:30 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51 Nov 05 08:31:30 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:30 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-499b5769-b602-4cf3-9e50-6d497af97e51" returned: 0 in 0.566s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-499b5769-b602-4cf3-9e50-6d497af97e51" released by "delete_volume" :: held 1.098s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Created reservations ['0c8aa8db-5ca5-4c23-9ecc-0950c7d5d815', 'c5ac235b-08e0-4c2b-8025-b7322cadc76a', '467620b0-c172-4b85-9668-91c536829efc', '9bc8d64a-eb4e-4421-a856-3c3ba2d66995'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:31 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:31 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:31 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Deleted volume successfully. Nov 05 08:31:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8fa03b03-51f1-48a5-aec1-db6ce4e60648 tempest-VolumesActionsTest-210716267 None] Lock "cinder-499b5769-b602-4cf3-9e50-6d497af97e51-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (fcf92fe3-c7b5-4663-87a6-f5729afe8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72ef43-8055-4a92-b77a-0b362e54d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72ef43-8055-4a92-b77a-0b362e54d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101091252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684bb2d3-95a9-4b24-bc50-16eb6be6c230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:33Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75565a14-eaf5-485d-92b7-4634e4a224a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75565a14-eaf5-485d-92b7-4634e4a224a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e145fe2-d1b7-43d9-9b6f-796408cbe6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e145fe2-d1b7-43d9-9b6f-796408cbe6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684bb2d3-95a9-4b24-bc50-16eb6be6c230', 'volume_name': 'volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6347dfa-d76d-43f2-aeb2-e6f2117e319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6347dfa-d76d-43f2-aeb2-e6f2117e319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3dff28-b5a0-4616-b94f-f942c4be1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Volume 684bb2d3-95a9-4b24-bc50-16eb6be6c230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230', 'volume_size': 1} Nov 05 08:31:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:37 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3" returned: 0 in 8.100s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:37 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:31:37 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Converted 1024.00 MB image at 126.41 MB/s Nov 05 08:31:37 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 is being set with open permissions: ugo+rw Nov 05 08:31:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:37 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 Nov 05 08:31:37 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:38 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3" returned: 0 in 0.242s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" released by "_copy_volume_from_snapshot" :: held 9.383s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-b0eba2d6-083e-453e-be36-46cf90b71aa3" released by "_create_volume_from_snapshot" :: held 9.475s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.516s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.293s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1120185455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc53bb4-cbd2-4dce-880e-af9be5afdeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbae4edbf14c416e8d84e765f8d418b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:29Z,use_quota=True,user_id='d0a8e205c224417699651a9360b9149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Creating volume 7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:38 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 1073741824 Nov 05 08:31:38 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd50158-f9ca-4312-9df8-bf1483782721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0eba2d6-083e-453e-be36-46cf90b71aa3', 'volume_size': 2, 'snapshot_id': '4fc93c20-31aa-4319-9f81-dc6c0d6d4e40'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c698d3e2-7aea-47d6-8ea4-18d090d0073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Volume volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 (b0eba2d6-083e-453e-be36-46cf90b71aa3): created successfully Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c698d3e2-7aea-47d6-8ea4-18d090d0073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (285d783b-a1f6-4105-b1c5-f2ba4aec9020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-51b4e563-4925-4831-97e6-9344d90263bc tempest-VolumesSnapshotTestJSON-1364459749 None] Created volume successfully. Nov 05 08:31:38 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 1073741824" returned: 0 in 0.497s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:38 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 Nov 05 08:31:38 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:39 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.690s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101091252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684bb2d3-95a9-4b24-bc50-16eb6be6c230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:33Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Creating volume 684bb2d3-95a9-4b24-bc50-16eb6be6c230 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:39 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6848b3aa-e031-44bb-9954-0c01a898801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:39 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 1073741824 Nov 05 08:31:39 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e464e2-4e2d-4306-bcc3-d19ef1b75e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Volume volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 (7fc53bb4-cbd2-4dce-880e-af9be5afdeb7): created successfully Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e464e2-4e2d-4306-bcc3-d19ef1b75e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Flow 'volume_create_manager' (f49368a7-fca5-4dee-87c2-1068c8055400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c44af2d0-d5f8-4f0a-a651-4002da84351d tempest-VolumesTransfersV355Test-1111367735 None] Created volume successfully. Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-b0eba2d6-083e-453e-be36-46cf90b71aa3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-b0eba2d6-083e-453e-be36-46cf90b71aa3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21868d6-8400-4b89-a5b9-137fb90b4b79]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:39 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 1073741824" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:39 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 Nov 05 08:31:39 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:39 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 Nov 05 08:31:39 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3dff28-b5a0-4616-b94f-f942c4be1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a1d33-3b4c-4f21-922f-fe3d71006363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:40 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3 Nov 05 08:31:40 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Volume volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 (684bb2d3-95a9-4b24-bc50-16eb6be6c230): created successfully Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31a1d33-3b4c-4f21-922f-fe3d71006363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (fcf92fe3-c7b5-4663-87a6-f5729afe8242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aa98063b-2d42-4bb8-8948-0fd2b66c5735 tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:40 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b0eba2d6-083e-453e-be36-46cf90b71aa3" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-b0eba2d6-083e-453e-be36-46cf90b71aa3" released by "delete_volume" :: held 0.922s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['f1480af3-5f24-42a0-b8e4-57e1f55da384', '4b562c53-d50e-4682-8c8a-0ede168c728f', '8c868f64-ac60-4ed6-9cd1-80f212eaf323', 'ce379fd4-1d00-4883-bc3a-36ea8d32f28a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:40 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:40 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:40 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Deleted volume successfully. Nov 05 08:31:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30f345ab-651d-42aa-88ac-d974d58f697b tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-b0eba2d6-083e-453e-be36-46cf90b71aa3-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:41 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45530b3a-7596-47fd-830e-bf74a29e0743 tempest-VolumesTransfersV355Test-1517676591 None] Transfer volume completed successfully. Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-684bb2d3-95a9-4b24-bc50-16eb6be6c230-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "cinder-684bb2d3-95a9-4b24-bc50-16eb6be6c230-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-quobyte-684bb2d3-95a9-4b24-bc50-16eb6be6c230" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-684bb2d3-95a9-4b24-bc50-16eb6be6c230" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1571f1-56b6-4073-8578-ba854fa07f0d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:41 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 Nov 05 08:31:41 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "cinder-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Deleting offline snapshot 4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 of volume 048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] snapshot_file for this snap is: volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:31:41 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11df8e-fc10-412c-951e-bc02d7ac4265]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230" returned: 0 in 0.509s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "cinder-quobyte-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:41 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230 Nov 05 08:31:41 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-quobyte-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892df63-87e6-494b-bb45-7ee392d34374]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:42 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 Nov 05 08:31:42 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-684bb2d3-95a9-4b24-bc50-16eb6be6c230" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:42 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-684bb2d3-95a9-4b24-bc50-16eb6be6c230" released by "delete_volume" :: held 1.031s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048978aa-b7ac-435a-b647-cba0a676a033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0fe96d-a2ab-4bc8-bcea-37f6bc6fb3a4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" returned: 0 in 0.480s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7 Nov 05 08:31:42 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Created reservations ['95280cac-7989-4da7-a894-7dce04e0f307', '7734639b-6b7e-4900-b426-31f5c515af27', 'd22be539-2d21-40f1-9864-6afebd2fcab6', 'b36ed6c1-42b7-4c93-a897-288b5e7dc252'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:42 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:42 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:42 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:42 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:42 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:43 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Deleted volume successfully. Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" returned: 0 in 0.509s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-quobyte-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7" released by "delete_volume" :: held 1.058s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81defe0f-bfe0-4f45-a0fb-8ffa523ddcfc tempest-VolumesActionsTest-210716267 None] Lock "cinder-684bb2d3-95a9-4b24-bc50-16eb6be6c230-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Created reservations ['053bb839-f368-4c62-bbac-c659a6ee2ddb', '61264e0b-496d-4655-8dbc-366b0367b9c7', '86c55dfa-9477-4008-8b2c-47ca845f1d61', '5520b685-ddbb-4797-ae8b-78f49259bc54'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:43 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.903s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:43 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:43 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Deleted volume successfully. Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f548d4a7-6eaf-4822-9a2c-4a112e044f35 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-7fc53bb4-cbd2-4dce-880e-af9be5afdeb7-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:43 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:43 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40 Nov 05 08:31:43 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:44 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033.4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" returned: 0 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40" released by "_delete_snapshot" :: held 2.356s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" released by "delete_snapshot" :: held 2.438s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (ff0017df-3a44-427a-8bbe-2bc707da14eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0efabc8-2828-4b06-a580-24dedabe4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0efabc8-2828-4b06-a580-24dedabe4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232553104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0520f758-b0c9-497d-bf20-7d2bf9cd2d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:44Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b93364-f8f1-4cfc-84f2-488b21c07ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b93364-f8f1-4cfc-84f2-488b21c07ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec90332-36ac-4db7-b8e2-c323fd44a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec90332-36ac-4db7-b8e2-c323fd44a554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0520f758-b0c9-497d-bf20-7d2bf9cd2d40', 'volume_name': 'volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdaafbe-8da6-478b-adb0-d776b5e34660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdaafbe-8da6-478b-adb0-d776b5e34660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352823f7-cc13-43b8-b156-d233586980e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Volume 0520f758-b0c9-497d-bf20-7d2bf9cd2d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40', 'volume_size': 1} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-232553104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0520f758-b0c9-497d-bf20-7d2bf9cd2d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:44Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Creating volume 0520f758-b0c9-497d-bf20-7d2bf9cd2d40 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:44 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 1073741824 Nov 05 08:31:44 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['7353ff01-c1ff-4f5d-ad5d-360e548b0e23', '9c5de53b-bce4-47ff-991b-629a989390c2', '1dc562c6-10ed-49ba-8583-4851572e43fa', '4285065b-0a77-43f5-9e2e-fbb4f88508ea'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Delete snapshot completed successfully. Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-eda95336-3ad0-4e19-9b08-413abc9c0b5d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-4fc93c20-31aa-4319-9f81-dc6c0d6d4e40-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Flow 'volume_create_manager' (2a73f896-1626-490f-9748-d94255a6940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb9adc-5647-4236-8fd1-2f4ccf22ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb9adc-5647-4236-8fd1-2f4ccf22ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1708450830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d514a86-741a-4567-883b-f0005aad35f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbae4edbf14c416e8d84e765f8d418b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:45Z,use_quota=True,user_id='d0a8e205c224417699651a9360b9149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c847e6-eb51-455d-86a6-55d31afb0bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c847e6-eb51-455d-86a6-55d31afb0bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdedf46-5e4d-4791-9719-14375ab9a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdedf46-5e4d-4791-9719-14375ab9a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d514a86-741a-4567-883b-f0005aad35f4', 'volume_name': 'volume-2d514a86-741a-4567-883b-f0005aad35f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8f340b-16c2-4597-b8c2-099c4474bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8f340b-16c2-4597-b8c2-099c4474bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88200db2-7482-4b77-9dd4-b4d9ac935778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Volume 2d514a86-741a-4567-883b-f0005aad35f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d514a86-741a-4567-883b-f0005aad35f4', 'volume_size': 1} Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:44 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 1073741824" returned: 0 in 0.579s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 Nov 05 08:31:45 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-048978aa-b7ac-435a-b647-cba0a676a033-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-048978aa-b7ac-435a-b647-cba0a676a033-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3fcf42-40e6-4cfb-a27a-b89dfbb5c86d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:45 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1708450830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d514a86-741a-4567-883b-f0005aad35f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbae4edbf14c416e8d84e765f8d418b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:45Z,use_quota=True,user_id='d0a8e205c224417699651a9360b9149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Creating volume 2d514a86-741a-4567-883b-f0005aad35f4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352823f7-cc13-43b8-b156-d233586980e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7d2f7c-00b9-4678-b7de-2d65be5db96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:45 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 1073741824 Nov 05 08:31:45 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Volume volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 (0520f758-b0c9-497d-bf20-7d2bf9cd2d40): created successfully Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7d2f7c-00b9-4678-b7de-2d65be5db96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (ff0017df-3a44-427a-8bbe-2bc707da14eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-91518a6d-e465-4364-834a-34b82f8b0d12 tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:45 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033 Nov 05 08:31:45 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:45 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 1073741824" returned: 0 in 0.563s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-048978aa-b7ac-435a-b647-cba0a676a033" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-048978aa-b7ac-435a-b647-cba0a676a033" released by "delete_volume" :: held 0.826s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:45 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 Nov 05 08:31:46 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['1e598445-3e44-487f-bbbb-11e744de7dea', '306023d0-0f0e-40b5-aed5-14fce5827fe2', '24a8901b-6a62-4522-b5f6-11f907d1a8b5', '404d1e48-2837-4e56-8fa5-8ecdbb1eb800'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:46 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:46 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:46 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88200db2-7482-4b77-9dd4-b4d9ac935778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d514a86-741a-4567-883b-f0005aad35f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef41c82f-a93f-4c93-924f-19b759105f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Volume volume-2d514a86-741a-4567-883b-f0005aad35f4 (2d514a86-741a-4567-883b-f0005aad35f4): created successfully Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef41c82f-a93f-4c93-924f-19b759105f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Flow 'volume_create_manager' (2a73f896-1626-490f-9748-d94255a6940e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fd27e87c-2234-4505-8fd7-4d99ce5216ae tempest-VolumesTransfersV355Test-1111367735 None] Created volume successfully. Nov 05 08:31:46 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Deleted volume successfully. Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0683332c-d59b-42df-bb53-39501b6e2045 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-048978aa-b7ac-435a-b647-cba0a676a033-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-0520f758-b0c9-497d-bf20-7d2bf9cd2d40-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "cinder-0520f758-b0c9-497d-bf20-7d2bf9cd2d40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Acquiring lock "cinder-quobyte-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04585e9-36eb-40e5-bfe3-538ef059299c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:46 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 Nov 05 08:31:46 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (0358c0d4-1ada-4e07-b29a-39de4fba6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4998b3aa-4255-4ccd-a560-dbecb88d7b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4998b3aa-4255-4ccd-a560-dbecb88d7b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304225052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:47Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e6072d-0d7d-4ff1-9267-42f4ce5fe1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e6072d-0d7d-4ff1-9267-42f4ce5fe1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba43f0-f1fd-489a-800a-1ed47b1f0d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba43f0-f1fd-489a-800a-1ed47b1f0d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc', 'volume_name': 'volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2036828-c15c-40d8-8602-f9d15f803ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2036828-c15c-40d8-8602-f9d15f803ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d5a6bd-67b3-45de-bdaf-92d1d85eeab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Volume 2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc', 'volume_size': 1} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304225052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:47Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Creating volume 2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc 1073741824 Nov 05 08:31:47 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" returned: 0 in 0.568s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40 Nov 05 08:31:47 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "cinder-2d514a86-741a-4567-883b-f0005aad35f4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-2d514a86-741a-4567-883b-f0005aad35f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=112,cinder:INSERT=46,cinder:UPDATE=165,cinder:DELETE=19 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=166,cinder:SELECT=148,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "cinder-quobyte-2d514a86-741a-4567-883b-f0005aad35f4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-quobyte-2d514a86-741a-4567-883b-f0005aad35f4" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f026d84-723e-4bde-a974-96ea8a19c699]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 Nov 05 08:31:47 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "cinder-quobyte-0520f758-b0c9-497d-bf20-7d2bf9cd2d40" released by "delete_volume" :: held 1.010s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:47 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc 1073741824" returned: 0 in 0.583s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Created reservations ['ef9653f9-568d-4257-ae8d-5d7e9b5e20ad', '09e593ca-272e-405f-a7cb-24704586cd55', '7692ea57-477d-4eb0-a7de-8d209276d13a', '02b7d8e1-676a-4ca6-80b6-1def39a15892'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:31:47 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:47 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:47 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:47 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4" returned: 0 in 0.464s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:48 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4 Nov 05 08:31:48 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2d5a6bd-67b3-45de-bdaf-92d1d85eeab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6d8a20-466e-422e-b65d-36f00d524dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Volume volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc (2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc): created successfully Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6d8a20-466e-422e-b65d-36f00d524dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (0358c0d4-1ada-4e07-b29a-39de4fba6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:48 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Deleted volume successfully. Nov 05 08:31:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-560dbd66-e983-4d62-b97e-b2e1cc3c7303 tempest-VolumesSnapshotTestJSON-1364459749 None] Created volume successfully. Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f3b117ad-d381-4fce-b116-f2f64ece2f33 tempest-VolumesActionsTest-210716267 None] Lock "cinder-0520f758-b0c9-497d-bf20-7d2bf9cd2d40-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:48 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2d514a86-741a-4567-883b-f0005aad35f4" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-quobyte-2d514a86-741a-4567-883b-f0005aad35f4" released by "delete_volume" :: held 0.805s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Created reservations ['552f4b66-a498-4c8e-8b51-f99a27fc6fec', 'dfef6ed9-a5b8-4488-b5a9-1cb1bf5a2016', '34f27a0b-4038-4ff3-b50d-feb28b079e90', '20d35842-407b-4826-9158-708c2f454026'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:48 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:48 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:48 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Deleted volume successfully. Nov 05 08:31:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3a22ccd7-add6-4a7d-8c22-b4cb00904669 tempest-VolumesTransfersV355Test-126048832 None] Lock "cinder-2d514a86-741a-4567-883b-f0005aad35f4-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (f77cd696-0aa3-4fd3-98be-c47375bbe897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1463ecd5-9522-40bf-84a1-4970b9872caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1463ecd5-9522-40bf-84a1-4970b9872caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-497360150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fba573d-f27c-4c87-bead-38fe3236fb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:50Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3172a3-6547-4e44-a681-aafae52b3048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3172a3-6547-4e44-a681-aafae52b3048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7821aab2-c1e1-4dfa-ab00-99ffa22ab2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7821aab2-c1e1-4dfa-ab00-99ffa22ab2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fba573d-f27c-4c87-bead-38fe3236fb40', 'volume_name': 'volume-0fba573d-f27c-4c87-bead-38fe3236fb40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863a2b98-4fd0-4c85-84b7-ad100ba8e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863a2b98-4fd0-4c85-84b7-ad100ba8e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed18cbd-8693-4708-81ba-0a2f43846616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Volume 0fba573d-f27c-4c87-bead-38fe3236fb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fba573d-f27c-4c87-bead-38fe3236fb40', 'volume_size': 1} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Creating offline snapshot 48b94fca-28ff-4585-be03-1755f4d87c87 of volume 2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4d92a-b74b-4f2c-99d0-55518fbc99ab]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:49 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:31:49 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:50 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 1G Nov 05 08:31:50 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:50 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 1G" returned: 0 in 0.554s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:50 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:31:50 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:51 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 is being set with open permissions: ugo+rw Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:51 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:31:51 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:51 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:51 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info Nov 05 08:31:51 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:51 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info is being set with open permissions: ugo+rw Nov 05 08:31:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:51 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info Nov 05 08:31:51 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:52 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.info" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.356s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-497360150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fba573d-f27c-4c87-bead-38fe3236fb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1255756c86dc48fa955a64cb779f2b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:50Z,use_quota=True,user_id='5587ce9df40c49cc99d875729ac04b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Creating volume 0fba573d-f27c-4c87-bead-38fe3236fb40 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:52 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:52 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 1073741824 Nov 05 08:31:52 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-24221fc6-00e2-4866-8165-792a57b6bade tempest-VolumesSnapshotTestJSON-1364459749 None] Create snapshot completed successfully Nov 05 08:31:52 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 1073741824" returned: 0 in 0.601s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:52 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 Nov 05 08:31:52 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:53 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed18cbd-8693-4708-81ba-0a2f43846616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fba573d-f27c-4c87-bead-38fe3236fb40', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2e3861-4d08-4f48-9ad2-cbace8b81a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Volume volume-0fba573d-f27c-4c87-bead-38fe3236fb40 (0fba573d-f27c-4c87-bead-38fe3236fb40): created successfully Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2e3861-4d08-4f48-9ad2-cbace8b81a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Flow 'volume_create_manager' (f77cd696-0aa3-4fd3-98be-c47375bbe897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f1195b81-4a6a-4540-9080-5215ef0d2647 tempest-VolumesActionsTest-340709335 None] Created volume successfully. Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (fe0efde8-a33f-4f28-8471-364e8bfd6607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845871b0-2f5a-4cd7-9d25-7ff86ea2e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845871b0-2f5a-4cd7-9d25-7ff86ea2e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1331326397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c810f694-eb7f-4770-8d46-a6ed5692a7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a735908e4aaf48698629590a1d5bc812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48b94fca-28ff-4585-be03-1755f4d87c87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:53Z,use_quota=True,user_id='3b445fe709d2490393b50cfcd9fcabb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c1727-445a-4fa4-b745-a2533c6f0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c1727-445a-4fa4-b745-a2533c6f0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dbd455-b826-4bd3-a8c5-16f509bcc401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dbd455-b826-4bd3-a8c5-16f509bcc401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c810f694-eb7f-4770-8d46-a6ed5692a7db', 'volume_name': 'volume-c810f694-eb7f-4770-8d46-a6ed5692a7db', 'volume_size': 1, 'snapshot_id': '48b94fca-28ff-4585-be03-1755f4d87c87'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5b2367-a7d9-4acc-bcf6-a8fd274281af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5b2367-a7d9-4acc-bcf6-a8fd274281af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf0af19-87a5-4d58-b67c-44cc09fea5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Volume c810f694-eb7f-4770-8d46-a6ed5692a7db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c810f694-eb7f-4770-8d46-a6ed5692a7db', 'volume_size': 1, 'snapshot_id': '48b94fca-28ff-4585-be03-1755f4d87c87'} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87-c810f694-eb7f-4770-8d46-a6ed5692a7db" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87-c810f694-eb7f-4770-8d46-a6ed5692a7db" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Creating volume c810f694-eb7f-4770-8d46-a6ed5692a7db from snapshot 48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] snapshot: 48b94fca-28ff-4585-be03-1755f4d87c87, volume: c810f694-eb7f-4770-8d46-a6ed5692a7db, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622657f-c61f-4d6b-b570-1e8457ba1743]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:53 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:31:53 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:54 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.534s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0246165-4826-42df-9408-023aec68aca6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:54 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:31:54 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-0fba573d-f27c-4c87-bead-38fe3236fb40-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "cinder-0fba573d-f27c-4c87-bead-38fe3236fb40-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Acquiring lock "cinder-quobyte-0fba573d-f27c-4c87-bead-38fe3236fb40" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "cinder-quobyte-0fba573d-f27c-4c87-bead-38fe3236fb40" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d665b-1a55-43cc-a2bc-0a67ecb6b82d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:54 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:31:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:54 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db Nov 05 08:31:54 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:54 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 Nov 05 08:31:54 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:55 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:55 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40 Nov 05 08:31:55 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:55 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0fba573d-f27c-4c87-bead-38fe3236fb40" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "cinder-quobyte-0fba573d-f27c-4c87-bead-38fe3236fb40" released by "delete_volume" :: held 0.932s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Created reservations ['d196a7a5-7473-4bbb-a2bd-b2616e35c1f8', '3c0bed2d-3a1a-4d1b-8720-9a5cdadb1e99', '34982b3f-7926-4761-80aa-3ed214705c89', '5551261e-5a30-4ca8-92a6-5f522249de15'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:31:56 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:31:56 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:31:56 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.667s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:31:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Deleted volume successfully. Nov 05 08:31:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ad613de-03c7-4fb4-af5b-37198f551887 tempest-VolumesActionsTest-340709335 None] Lock "cinder-0fba573d-f27c-4c87-bead-38fe3236fb40-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Flow 'volume_create_manager' (02e58b6d-6622-4515-95a1-56ca7bc91f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e4b851-89c0-4dd4-8307-c3d753e58611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e4b851-89c0-4dd4-8307-c3d753e58611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-856168325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4e4802-2232-4681-b464-adf855245799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1c0c0095f48b48d3a1e9b81a31052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:58Z,use_quota=True,user_id='4362b6b8780544b48b8f9368f3723e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c01863-f4af-4b51-a0dd-9134a3305675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c01863-f4af-4b51-a0dd-9134a3305675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cefcaad-70ac-4ee3-8a8f-e93b1a7babcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cefcaad-70ac-4ee3-8a8f-e93b1a7babcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4e4802-2232-4681-b464-adf855245799', 'volume_name': 'volume-7d4e4802-2232-4681-b464-adf855245799', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1389ffa-dec3-4432-9dd4-44a8c59e421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1389ffa-dec3-4432-9dd4-44a8c59e421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edd03e-a2e0-472c-b506-d4c6a7830f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:31:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Volume 7d4e4802-2232-4681-b464-adf855245799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4e4802-2232-4681-b464-adf855245799', 'volume_size': 1} Nov 05 08:31:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Flow 'volume_create_manager' (a7fed1ca-de26-48f1-b4f8-2d150cdadb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777f7b4f-9e81-4892-9f70-e462768b741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777f7b4f-9e81-4892-9f70-e462768b741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1200956135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd40f7a9f8b40ad93fc9894e989cf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:02Z,use_quota=True,user_id='a17b0c82844b4e7c82debd4c10594ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539d496-3593-4fc9-85d0-061472f9b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539d496-3593-4fc9-85d0-061472f9b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f578bf16-77f6-45c0-a5fe-6e97f454ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f578bf16-77f6-45c0-a5fe-6e97f454ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed', 'volume_name': 'volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85e5c78-c93d-49e6-852e-8c7863f154d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85e5c78-c93d-49e6-852e-8c7863f154d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97198bc1-6b6d-46f4-ba2c-948fcb963c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Volume 1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed', 'volume_size': 1} Nov 05 08:32:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:03 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db" returned: 0 in 8.621s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:32:03 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Converted 1024.00 MB image at 118.77 MB/s Nov 05 08:32:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db is being set with open permissions: ugo+rw Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:03 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db Nov 05 08:32:03 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:03 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" released by "_copy_volume_from_snapshot" :: held 10.205s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87-c810f694-eb7f-4770-8d46-a6ed5692a7db" released by "_create_volume_from_snapshot" :: held 10.278s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.294s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.493s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-856168325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4e4802-2232-4681-b464-adf855245799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1c0c0095f48b48d3a1e9b81a31052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:31:58Z,use_quota=True,user_id='4362b6b8780544b48b8f9368f3723e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Creating volume 7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:03 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 1073741824 Nov 05 08:32:03 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf0af19-87a5-4d58-b67c-44cc09fea5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c810f694-eb7f-4770-8d46-a6ed5692a7db', 'volume_size': 1, 'snapshot_id': '48b94fca-28ff-4585-be03-1755f4d87c87'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26967b8-ff15-400e-a3de-d02d5dcc2754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Volume volume-c810f694-eb7f-4770-8d46-a6ed5692a7db (c810f694-eb7f-4770-8d46-a6ed5692a7db): created successfully Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26967b8-ff15-400e-a3de-d02d5dcc2754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Flow 'volume_create_manager' (fe0efde8-a33f-4f28-8471-364e8bfd6607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f9044ce4-dffc-4ea3-80f9-b75631e14ceb tempest-VolumesSnapshotTestJSON-1364459749 None] Created volume successfully. Nov 05 08:32:04 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 1073741824" returned: 0 in 0.467s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:04 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:04 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1200956135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dd40f7a9f8b40ad93fc9894e989cf0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:02Z,use_quota=True,user_id='a17b0c82844b4e7c82debd4c10594ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Creating volume 1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:04 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edd03e-a2e0-472c-b506-d4c6a7830f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4e4802-2232-4681-b464-adf855245799', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:04 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed 1073741824 Nov 05 08:32:04 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ad5d45-edf1-48cd-aa80-5618ba8d8e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Volume volume-7d4e4802-2232-4681-b464-adf855245799 (7d4e4802-2232-4681-b464-adf855245799): created successfully Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ad5d45-edf1-48cd-aa80-5618ba8d8e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Flow 'volume_create_manager' (02e58b6d-6622-4515-95a1-56ca7bc91f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9c2fff0-3e9a-4600-98bf-c7b40cb3d403 tempest-VolumesCloneTest-657191880 None] Created volume successfully. Nov 05 08:32:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-c810f694-eb7f-4770-8d46-a6ed5692a7db-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-c810f694-eb7f-4770-8d46-a6ed5692a7db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ea2c7-dd10-4e10-ae0c-ffbcda0e6bf6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db Nov 05 08:32:05 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed 1073741824" returned: 0 in 0.561s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:05 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:05 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db Nov 05 08:32:05 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:05 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97198bc1-6b6d-46f4-ba2c-948fcb963c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d7f9c1-34ab-4dad-86ae-ce709153d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Volume volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed (1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed): created successfully Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d7f9c1-34ab-4dad-86ae-ce709153d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Flow 'volume_create_manager' (a7fed1ca-de26-48f1-b4f8-2d150cdadb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b5e3b6c1-8666-41b3-8750-fad8d64297ed tempest-TestImageHashVerification-936838142 None] Created volume successfully. Nov 05 08:32:05 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c810f694-eb7f-4770-8d46-a6ed5692a7db" returned: 0 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-c810f694-eb7f-4770-8d46-a6ed5692a7db" released by "delete_volume" :: held 0.783s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:05 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['b804eac4-01a5-4926-9c11-1b886d5c3f32', 'e371dab9-9015-4cb9-bdfb-177582fea2a8', '18201ed6-77ce-49aa-9d46-683587569352', 'be1d7691-b950-41b6-b36b-a1926e42545f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:06 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Deleted volume successfully. Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1ee25e46-b60e-4e29-bbd3-89ca621d2b6e tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-c810f694-eb7f-4770-8d46-a6ed5692a7db-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-48b94fca-28ff-4585-be03-1755f4d87c87-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-48b94fca-28ff-4585-be03-1755f4d87c87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Flow 'volume_create_manager' (e71a4a84-10e8-4e23-ba0f-577c778fca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdccf7bf-8efb-4100-a0a0-da9d5a7deed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Deleting offline snapshot 48b94fca-28ff-4585-be03-1755f4d87c87 of volume 2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] snapshot_file for this snap is: volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdccf7bf-8efb-4100-a0a0-da9d5a7deed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1882311953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee48d3f-ba19-4610-b13c-af16fe0bd36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1c0c0095f48b48d3a1e9b81a31052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7d4e4802-2232-4681-b464-adf855245799,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:07Z,use_quota=True,user_id='4362b6b8780544b48b8f9368f3723e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c7fdc8-5a35-4190-9984-15a5981993e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c7fdc8-5a35-4190-9984-15a5981993e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076a2986-72e9-4601-9bb6-402c65b1e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8367a8-06ae-4cfd-8cc6-e2e8dfb30a6c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076a2986-72e9-4601-9bb6-402c65b1e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3ee48d3f-ba19-4610-b13c-af16fe0bd36b', 'volume_name': 'volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b', 'volume_size': 2, 'source_volid': '7d4e4802-2232-4681-b464-adf855245799', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea1f718-c52a-4b42-a8b8-871432e4dcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea1f718-c52a-4b42-a8b8-871432e4dcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524a4541-7171-417f-8f1e-d391676ac7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Volume 3ee48d3f-ba19-4610-b13c-af16fe0bd36b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b', 'volume_size': 2, 'source_volid': '7d4e4802-2232-4681-b464-adf855245799', 'source_volstatus': 'available'} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Cloning volume 7d4e4802-2232-4681-b464-adf855245799 to volume 3ee48d3f-ba19-4610-b13c-af16fe0bd36b Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Creating offline snapshot 5c1169fe-9a2b-4229-bcc7-22010fa2943f of volume 7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27a6758-228c-47a9-b6dd-b24e33de3184]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:06 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:32:06 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:07 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:07 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.448s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a3693-876c-4aed-9112-fc92f01a10c6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:32:07 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f 1G Nov 05 08:32:07 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.580s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f 1G" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4e4802-2232-4681-b464-adf855245799 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:07 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:32:07 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:07 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4e4802-2232-4681-b464-adf855245799 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:07 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4e4802-2232-4681-b464-adf855245799 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f is being set with open permissions: ugo+rw Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:08 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87 Nov 05 08:32:08 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc.48b94fca-28ff-4585-be03-1755f4d87c87" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info Nov 05 08:32:08 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-48b94fca-28ff-4585-be03-1755f4d87c87" released by "_delete_snapshot" :: held 1.841s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" released by "delete_snapshot" :: held 1.894s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['485e0ac0-3237-4214-882d-d5255fe7d39f', 'c64b1078-13fa-42b6-b884-dae09e503be0', '3be3611f-8ed2-4ec9-8742-2c11e7e5f378', '3e1240af-91c0-452d-b5bc-10d7f78c027e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Delete snapshot completed successfully. Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5e236378-2bf7-4d1a-a400-1fb720dbb337 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-48b94fca-28ff-4585-be03-1755f4d87c87-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:08 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:08 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info is being set with open permissions: ugo+rw Nov 05 08:32:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:08 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info Nov 05 08:32:08 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.info" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] snapshot: 5c1169fe-9a2b-4229-bcc7-22010fa2943f, volume: 3ee48d3f-ba19-4610-b13c-af16fe0bd36b, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a8657-7ef4-4682-b4ab-785bec495e11]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:09 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4e4802-2232-4681-b464-adf855245799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2887254c-2eba-4010-a82e-4f4845a8bf0b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:09 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:09 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2fe64b-c931-47e0-8c53-4ade0ad3db53]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:10 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.506s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:10 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b Nov 05 08:32:10 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:10 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:32:10 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:10 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:10 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc Nov 05 08:32:10 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:10 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc" released by "delete_volume" :: held 0.992s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['ba95eafd-5e32-49e3-a64e-a1be990059f8', 'cc32b98a-10f1-4853-875f-ee89d059a172', '1ca987e5-b5ec-4ac3-ae82-8d47404dd7d3', '5f59e071-ca2a-4b76-a61f-b310ffdd969a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:11 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:11 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:11 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Deleted volume successfully. Nov 05 08:32:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9017f18a-ccad-47fd-8f7d-4f994ce29f75 tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-2bf1c6d2-52bc-4bca-8c26-c7d0ae7711fc-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-6825366f-2f43-458f-9d0a-01f8457634c5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-6825366f-2f43-458f-9d0a-01f8457634c5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7265b3-71f3-4660-81cd-186d7dd7820b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:12 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 Nov 05 08:32:12 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:13 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5" returned: 0 in 0.661s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:13 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5 Nov 05 08:32:13 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:14 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6825366f-2f43-458f-9d0a-01f8457634c5" returned: 0 in 0.666s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-quobyte-6825366f-2f43-458f-9d0a-01f8457634c5" released by "delete_volume" :: held 1.505s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Created reservations ['7078836b-48ee-4268-9de0-689d33526a09', '80952ebc-f230-4b34-8171-106e03d46b49', '6b7f20d5-0615-4bea-aeed-50ddb32f63b3', 'f0a90f0e-4eb8-40ee-a62e-8126c04c6064'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:14 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:14 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:14 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Deleted volume successfully. Nov 05 08:32:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4f90b41-c875-429f-aa4a-15fccc51303d tempest-VolumesSnapshotTestJSON-1364459749 None] Lock "cinder-6825366f-2f43-458f-9d0a-01f8457634c5-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:18 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:18 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:18 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" returned: 0 in 8.567s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:32:18 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Converted 1024.00 MB image at 119.50 MB/s Nov 05 08:32:18 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b is being set with open permissions: ugo+rw Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:18 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b Nov 05 08:32:18 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:18 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.486s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:32:18 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" released by "_copy_volume_from_snapshot" :: held 9.837s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-quobyte-5c1169fe-9a2b-4229-bcc7-22010fa2943f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-5c1169fe-9a2b-4229-bcc7-22010fa2943f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Deleting offline snapshot 5c1169fe-9a2b-4229-bcc7-22010fa2943f of volume 7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] snapshot_file for this snap is: volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0545c9-ca8a-488a-a688-3b4fae382f83]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:19 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:19 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:19 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.460s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4e4802-2232-4681-b464-adf855245799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b83799-ab0a-414e-a7d9-38238841ea67]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:19 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:19 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.562s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:20 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.443s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:20 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f Nov 05 08:32:20 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:20 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799.5c1169fe-9a2b-4229-bcc7-22010fa2943f" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-5c1169fe-9a2b-4229-bcc7-22010fa2943f" released by "_delete_snapshot" :: held 1.907s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.114s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 13.828s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524a4541-7171-417f-8f1e-d391676ac7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b', 'volume_size': 2, 'source_volid': '7d4e4802-2232-4681-b464-adf855245799', 'source_volstatus': 'available'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d6bde8-883b-49be-9008-dc21eb5ccce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c14707-3ec7-40fe-9720-3608d78d6297]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Volume volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b (3ee48d3f-ba19-4610-b13c-af16fe0bd36b): created successfully Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d6bde8-883b-49be-9008-dc21eb5ccce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Flow 'volume_create_manager' (e71a4a84-10e8-4e23-ba0f-577c778fca79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-28fc2652-9eac-47b0-91d1-33af061047c3 tempest-VolumesCloneTest-657191880 None] Created volume successfully. Nov 05 08:32:21 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:21 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:21 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.456s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6ff274-1278-4898-b0d0-7a8c71dfb3b5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:21 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:21 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:21 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.409s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed /opt/stack/data/cinder/conversion/1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed.temp_image.b69bf25b-8bc3-4e1f-9db0-5c814ee317712_l0tc6a.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:21 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed /opt/stack/data/cinder/conversion/1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed.temp_image.b69bf25b-8bc3-4e1f-9db0-5c814ee317712_l0tc6a.img Nov 05 08:32:21 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-3ee48d3f-ba19-4610-b13c-af16fe0bd36b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "cinder-3ee48d3f-ba19-4610-b13c-af16fe0bd36b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10550c8-ec9c-4136-b5f7-23a6f6df71d4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:23 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b Nov 05 08:32:23 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:23 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" returned: 0 in 0.877s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:24 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b Nov 05 08:32:24 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:24 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-3ee48d3f-ba19-4610-b13c-af16fe0bd36b" released by "delete_volume" :: held 1.599s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Created reservations ['214875b7-db10-496e-8052-1cccff923454', '9fd2fab0-6d8c-4fbe-970c-274d6840c5fa', '5d2aeb14-6358-4903-9337-20b421d57355', '36ca08e3-5bd1-4f4a-9b01-30380fb53229'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:25 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:25 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Flow 'volume_create_manager' (317f7fe3-3a5b-4a2a-9f64-0a340a3cd293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d2aaaf-782a-4d34-8a08-e481fbbd2b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d2aaaf-782a-4d34-8a08-e481fbbd2b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429528084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd421167-040c-4a68-93b5-4115e8e6c54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850aa1df65a7498bb8443e64b8dc9828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:25Z,use_quota=True,user_id='d5eb66a6bf8e44e9826f7637045a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de67a34-6944-40ca-9f43-431943e64ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de67a34-6944-40ca-9f43-431943e64ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4ed61f-e4a6-4c7d-babd-45e9ed06a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4ed61f-e4a6-4c7d-babd-45e9ed06a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd421167-040c-4a68-93b5-4115e8e6c54d', 'volume_name': 'volume-cd421167-040c-4a68-93b5-4115e8e6c54d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a53d3-7186-4f26-bc5f-0dc929b33241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:25 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a53d3-7186-4f26-bc5f-0dc929b33241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cfdb9f-9707-4105-82e0-be35ded2cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Volume cd421167-040c-4a68-93b5-4115e8e6c54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd421167-040c-4a68-93b5-4115e8e6c54d', 'volume_size': 1} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-7d4e4802-2232-4681-b464-adf855245799-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.688s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Deleted volume successfully. Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "cinder-7d4e4802-2232-4681-b464-adf855245799-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-be91e13c-d59e-42f9-a06e-33b3e6312f46 tempest-VolumesCloneTest-657191880 None] Lock "cinder-3ee48d3f-ba19-4610-b13c-af16fe0bd36b-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Acquiring lock "cinder-quobyte-7d4e4802-2232-4681-b464-adf855245799" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-7d4e4802-2232-4681-b464-adf855245799" acquired by "delete_volume" :: waited 0.044s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bde6823-bbc8-4367-a7e5-7e3bd49a532d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:26 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.681s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:26 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799 Nov 05 08:32:26 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:26 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7d4e4802-2232-4681-b464-adf855245799" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "cinder-quobyte-7d4e4802-2232-4681-b464-adf855245799" released by "delete_volume" :: held 1.230s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Created reservations ['cca93dd2-217c-4c16-bee8-935f04528bd8', '1090a7d9-56f9-44d8-a2bd-6ab8637e5b11', 'eb43ee9a-893d-4f2f-96a0-6611516ac1d7', 'c307e702-60ef-4103-86b0-f9f3e15cbc24'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:27 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:27 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:28 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.616s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Deleted volume successfully. Nov 05 08:32:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-946af266-4455-4283-9c44-e3ef7f6b7e06 tempest-VolumesCloneTest-657191880 None] Lock "cinder-7d4e4802-2232-4681-b464-adf855245799-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:30 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed /opt/stack/data/cinder/conversion/1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed.temp_image.b69bf25b-8bc3-4e1f-9db0-5c814ee317712_l0tc6a.img" returned: 0 in 8.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea026460-f4a7-4981-b77f-463cb1c1c49e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:30 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:30 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:30 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.649s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/conversion/1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed.temp_image.b69bf25b-8bc3-4e1f-9db0-5c814ee317712_l0tc6a.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:32:30 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Converted 1024.00 MB image at 121.64 MB/s Nov 05 08:32:30 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] b69bf25b-8bc3-4e1f-9db0-5c814ee31771 was raw, no need to convert to raw {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (26930b11-7316-434b-be94-0b8afb6a6892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4caa16e-83e3-4935-a6c7-c2acdfad33b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4caa16e-83e3-4935-a6c7-c2acdfad33b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-973474006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cad1b1c-4d52-4630-b7cf-d367cbd097d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:34Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bd9408-0b21-4016-9176-ded9a9edb01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bd9408-0b21-4016-9176-ded9a9edb01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16b62ac-c4d7-47f9-8ca8-64c90cf6783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16b62ac-c4d7-47f9-8ca8-64c90cf6783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cad1b1c-4d52-4630-b7cf-d367cbd097d7', 'volume_name': 'volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dce757-23fd-4626-8f99-70398aaeee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dce757-23fd-4626-8f99-70398aaeee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d678572-005c-46bd-964b-945ad3759a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:33 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Volume 1cad1b1c-4d52-4630-b7cf-d367cbd097d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7', 'volume_size': 1} Nov 05 08:32:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:43 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=62,cinder:UPDATE=100,cinder:DELETE=4,cinder:INSERT=22 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:32:43 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=72,cinder:INSERT=23,cinder:UPDATE=81,cinder:DELETE=11 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Flow 'volume_create_manager' (66f40253-b538-46c2-a8e4-9b76191e955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf469cb-99c5-4a2a-bf9a-1b55a8d5b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf469cb-99c5-4a2a-bf9a-1b55a8d5b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2031772366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a718f7-e232-41d1-867b-1a8adceae42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07b6160893648558f5575e4466c439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:52Z,use_quota=True,user_id='c24e6098983a4ef2a8ea2208951ed17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcc5e07-0ab9-41b4-9532-1d723289c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcc5e07-0ab9-41b4-9532-1d723289c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3753e4-0444-4b46-bd61-25fd8a00500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3753e4-0444-4b46-bd61-25fd8a00500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a718f7-e232-41d1-867b-1a8adceae42a', 'volume_name': 'volume-d3a718f7-e232-41d1-867b-1a8adceae42a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9493b6-e3de-42ba-8d82-2ae4207fe23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9493b6-e3de-42ba-8d82-2ae4207fe23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5547bf21-b1ca-4a49-9866-631be378ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume d3a718f7-e232-41d1-867b-1a8adceae42a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a718f7-e232-41d1-867b-1a8adceae42a', 'volume_size': 1} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Flow 'volume_create_manager' (d5bb39c7-0ce5-48c6-9eb0-94858ddf3700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b6ef3-9cc6-463a-8b81-76ee9e273759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775b6ef3-9cc6-463a-8b81-76ee9e273759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-662383408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709e91b0-2407-40c2-af61-8b83b276a79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07b6160893648558f5575e4466c439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:52Z,use_quota=True,user_id='c24e6098983a4ef2a8ea2208951ed17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a354c48-4599-4aab-b611-2dc7b2374cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a354c48-4599-4aab-b611-2dc7b2374cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f28c8e1-40f4-40b8-8dfc-e46fe10815ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f28c8e1-40f4-40b8-8dfc-e46fe10815ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709e91b0-2407-40c2-af61-8b83b276a79f', 'volume_name': 'volume-709e91b0-2407-40c2-af61-8b83b276a79f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4b4994-5994-4d1a-922b-3fe243b0a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4b4994-5994-4d1a-922b-3fe243b0a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0dede0-38ad-4325-aea4-b59857c6e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume 709e91b0-2407-40c2-af61-8b83b276a79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709e91b0-2407-40c2-af61-8b83b276a79f', 'volume_size': 1} Nov 05 08:32:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.386s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Uploaded volume to glance image-id: b69bf25b-8bc3-4e1f-9db0-5c814ee31771. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.712s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429528084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd421167-040c-4a68-93b5-4115e8e6c54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850aa1df65a7498bb8443e64b8dc9828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:25Z,use_quota=True,user_id='d5eb66a6bf8e44e9826f7637045a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Creating volume cd421167-040c-4a68-93b5-4115e8e6c54d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:53 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:53 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d 1073741824 Nov 05 08:32:53 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5c0e2894-1cfb-47a0-8cb4-0eec2ce2c6d0 tempest-TestImageHashVerification-936838142 None] Copy volume to image completed successfully. Nov 05 08:32:53 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d 1073741824" returned: 0 in 0.520s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:53 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d Nov 05 08:32:53 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Acquiring lock "cinder-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "cinder-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Acquiring lock "cinder-quobyte-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "cinder-quobyte-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:54 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe1b75-89f1-4190-badc-46d88eae8d09]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.421s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-973474006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cad1b1c-4d52-4630-b7cf-d367cbd097d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:34Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Creating volume 1cad1b1c-4d52-4630-b7cf-d367cbd097d7 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:54 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 1073741824 Nov 05 08:32:54 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cfdb9f-9707-4105-82e0-be35ded2cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd421167-040c-4a68-93b5-4115e8e6c54d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417a4cfe-fad6-4550-b350-eaeede810665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Volume volume-cd421167-040c-4a68-93b5-4115e8e6c54d (cd421167-040c-4a68-93b5-4115e8e6c54d): created successfully Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417a4cfe-fad6-4550-b350-eaeede810665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Flow 'volume_create_manager' (317f7fe3-3a5b-4a2a-9f64-0a340a3cd293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-be9835c0-b75f-4096-bdf3-8838fffc24b6 tempest-VolumesTransfersV357Test-793391911 None] Created volume successfully. Nov 05 08:32:54 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:54 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:54 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:54 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed Nov 05 08:32:54 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:54 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 1073741824" returned: 0 in 0.576s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:54 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 Nov 05 08:32:54 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "cinder-quobyte-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed" released by "delete_volume" :: held 0.853s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Created reservations ['4ff23d81-66ad-4959-ba9d-6ca3ede98719', '095d6a93-446b-4e2f-abce-956c039a8003', 'cf4e05a4-1fab-4330-9408-48f0a87eacc8', '3b5bfbb2-b5fb-4c43-97cc-45ef12ff7af6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:55 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.965s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2031772366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a718f7-e232-41d1-867b-1a8adceae42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07b6160893648558f5575e4466c439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:52Z,use_quota=True,user_id='c24e6098983a4ef2a8ea2208951ed17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Creating volume d3a718f7-e232-41d1-867b-1a8adceae42a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:55 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:55 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a 1073741824 Nov 05 08:32:55 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d678572-005c-46bd-964b-945ad3759a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad2bb54-a7f4-4d50-8821-eed132a81366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Volume volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 (1cad1b1c-4d52-4630-b7cf-d367cbd097d7): created successfully Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad2bb54-a7f4-4d50-8821-eed132a81366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:55 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:55 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (26930b11-7316-434b-be94-0b8afb6a6892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-703516df-dd1a-4c4b-b8c2-64c257de91b9 tempest-VolumesListTestJSON-1825802753 None] Created volume successfully. Nov 05 08:32:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-43010828-f6d9-4561-9863-6b48c27824e3 tempest-VolumesTransfersV357Test-1431207483 None] Transfer volume completed successfully. Nov 05 08:32:55 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Deleted volume successfully. Nov 05 08:32:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d97060a0-8662-4bdf-b7f6-47d7bec4659f tempest-TestImageHashVerification-936838142 None] Lock "cinder-1ad3963b-9e25-4e5f-9c29-f9939dd9e6ed-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:56 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a 1073741824" returned: 0 in 0.780s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:56 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a Nov 05 08:32:56 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:56 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.833s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-662383408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709e91b0-2407-40c2-af61-8b83b276a79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c07b6160893648558f5575e4466c439e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:52Z,use_quota=True,user_id='c24e6098983a4ef2a8ea2208951ed17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Creating volume 709e91b0-2407-40c2-af61-8b83b276a79f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:56 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "cinder-cd421167-040c-4a68-93b5-4115e8e6c54d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5547bf21-b1ca-4a49-9866-631be378ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a718f7-e232-41d1-867b-1a8adceae42a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f86192-92ad-4bd9-9996-e24a99749af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:56 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f 1073741824 Nov 05 08:32:56 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-cd421167-040c-4a68-93b5-4115e8e6c54d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume volume-d3a718f7-e232-41d1-867b-1a8adceae42a (d3a718f7-e232-41d1-867b-1a8adceae42a): created successfully Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f86192-92ad-4bd9-9996-e24a99749af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Flow 'volume_create_manager' (66f40253-b538-46c2-a8e4-9b76191e955f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-63f44134-ffbd-4999-8ee7-79ead4c4d7ef tempest-TestServerVolumeAttachmentScenario-836203038 None] Created volume successfully. Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "cinder-quobyte-cd421167-040c-4a68-93b5-4115e8e6c54d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-quobyte-cd421167-040c-4a68-93b5-4115e8e6c54d" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fede57db-dfdd-44b2-9bf3-ddfc6cd189dd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:32:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:56 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d Nov 05 08:32:56 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f 1073741824" returned: 0 in 0.889s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f Nov 05 08:32:57 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d" returned: 0 in 0.700s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d Nov 05 08:32:57 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (a6b70584-c83a-4906-abc6-15824a430447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2040c5-aa69-4993-9335-b14add4b2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2040c5-aa69-4993-9335-b14add4b2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17995459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6c7de5-aa80-422e-8601-d408021100a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fcb7f4-fa0f-4093-85af-dbc674a37809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fcb7f4-fa0f-4093-85af-dbc674a37809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bd337a-d68d-400f-a6e1-99c5bd6d9f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bd337a-d68d-400f-a6e1-99c5bd6d9f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6c7de5-aa80-422e-8601-d408021100a0', 'volume_name': 'volume-1a6c7de5-aa80-422e-8601-d408021100a0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00562d69-07ec-454d-9bba-eee56398bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00562d69-07ec-454d-9bba-eee56398bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc5a473-5500-4160-86ae-6498bd211818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Volume 1a6c7de5-aa80-422e-8601-d408021100a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6c7de5-aa80-422e-8601-d408021100a0', 'volume_size': 1} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:57 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cd421167-040c-4a68-93b5-4115e8e6c54d" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.225s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17995459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6c7de5-aa80-422e-8601-d408021100a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:32:58Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Creating volume 1a6c7de5-aa80-422e-8601-d408021100a0 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:57 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-quobyte-cd421167-040c-4a68-93b5-4115e8e6c54d" released by "delete_volume" :: held 1.190s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0dede0-38ad-4325-aea4-b59857c6e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709e91b0-2407-40c2-af61-8b83b276a79f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:57 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3749a2-cc94-49c6-a25d-4471f23e9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:57 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 1073741824 Nov 05 08:32:57 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Volume volume-709e91b0-2407-40c2-af61-8b83b276a79f (709e91b0-2407-40c2-af61-8b83b276a79f): created successfully Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3749a2-cc94-49c6-a25d-4471f23e9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Flow 'volume_create_manager' (d5bb39c7-0ce5-48c6-9eb0-94858ddf3700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8aef209e-8bfb-4333-92db-3448f2a1f413 tempest-TestServerVolumeAttachmentScenario-836203038 None] Created volume successfully. Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Created reservations ['f5d27e9d-c3da-45e0-90f3-10f1a0f0e05a', '08c07c82-69e6-418d-91f7-1bbefe3d8ba8', '1d836a83-0c13-4696-a36d-e02e4847fadf', 'bff26836-d99d-4681-8624-7ecf407c5f77'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:58 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:32:58 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:58 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.324s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:32:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Deleted volume successfully. Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a51833c3-3691-4640-8eb5-c9e062d8205b tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-cd421167-040c-4a68-93b5-4115e8e6c54d-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:32:58 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 1073741824" returned: 0 in 0.664s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:58 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 Nov 05 08:32:58 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:32:59 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc5a473-5500-4160-86ae-6498bd211818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6c7de5-aa80-422e-8601-d408021100a0', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2682ca8-3e55-4314-917b-f1701386cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Volume volume-1a6c7de5-aa80-422e-8601-d408021100a0 (1a6c7de5-aa80-422e-8601-d408021100a0): created successfully Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2682ca8-3e55-4314-917b-f1701386cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (a6b70584-c83a-4906-abc6-15824a430447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-929fb673-5823-4bc0-ace8-44c2e35856a6 tempest-VolumesListTestJSON-1825802753 None] Created volume successfully. Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Flow 'volume_create_manager' (10c00c9b-d599-4ae9-b170-7af2a35f0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbdf502-9c8d-46a7-935c-5d0c15a3deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbdf502-9c8d-46a7-935c-5d0c15a3deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-808564735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ccf810-3837-41dc-8985-9910a4e0fd37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850aa1df65a7498bb8443e64b8dc9828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:00Z,use_quota=True,user_id='d5eb66a6bf8e44e9826f7637045a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41bc525-f8a9-4a98-8724-ad6e36c45d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41bc525-f8a9-4a98-8724-ad6e36c45d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6a17c-cc27-4b3c-8c99-e6fe4a2709ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6a17c-cc27-4b3c-8c99-e6fe4a2709ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ccf810-3837-41dc-8985-9910a4e0fd37', 'volume_name': 'volume-d8ccf810-3837-41dc-8985-9910a4e0fd37', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0b4b05-35e4-47b3-9f5e-9fed7a7e5f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0b4b05-35e4-47b3-9f5e-9fed7a7e5f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97fa239-3492-449b-97ae-38de1dd22550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:32:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Volume d8ccf810-3837-41dc-8985-9910a4e0fd37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ccf810-3837-41dc-8985-9910a4e0fd37', 'volume_size': 1} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-808564735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ccf810-3837-41dc-8985-9910a4e0fd37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850aa1df65a7498bb8443e64b8dc9828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:00Z,use_quota=True,user_id='d5eb66a6bf8e44e9826f7637045a4efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Creating volume d8ccf810-3837-41dc-8985-9910a4e0fd37 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:32:59 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:32:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:32:59 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 1073741824 Nov 05 08:32:59 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (173f0ba0-670f-4758-81f2-504d12fdd54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed471e58-b3b7-4bc7-b9dc-7f9b2f8f4971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed471e58-b3b7-4bc7-b9dc-7f9b2f8f4971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156371681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f49e21-f678-4a0f-b602-76f37f6a0d68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:00Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0d0094-ce84-47ba-8ed4-28a87d8be886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0d0094-ce84-47ba-8ed4-28a87d8be886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4c580-9b75-409d-b7d9-4d19dbef6a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f4c580-9b75-409d-b7d9-4d19dbef6a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f49e21-f678-4a0f-b602-76f37f6a0d68', 'volume_name': 'volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8789d8-0943-457c-88a3-15c0f6c3e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8789d8-0943-457c-88a3-15c0f6c3e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900784d8-93a7-494d-8d19-a32095912877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Volume e4f49e21-f678-4a0f-b602-76f37f6a0d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68', 'volume_size': 1} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:00 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 1073741824" returned: 0 in 0.606s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:00 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 Nov 05 08:33:00 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37" returned: 0 in 0.324s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1156371681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f49e21-f678-4a0f-b602-76f37f6a0d68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e21d94eb1c84f4cb53e4f58486df96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:00Z,use_quota=True,user_id='bceab4f65fc44ca1b1d5afd0b865fffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Creating volume e4f49e21-f678-4a0f-b602-76f37f6a0d68 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:00 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97fa239-3492-449b-97ae-38de1dd22550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ccf810-3837-41dc-8985-9910a4e0fd37', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8ccd0-c56e-48a0-8d7a-5629f5252667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:00 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 1073741824 Nov 05 08:33:00 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Volume volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 (d8ccf810-3837-41dc-8985-9910a4e0fd37): created successfully Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad8ccd0-c56e-48a0-8d7a-5629f5252667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Flow 'volume_create_manager' (10c00c9b-d599-4ae9-b170-7af2a35f0b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d0eaf8a6-3a20-49a0-9dbd-2ddb6b3b9f2b tempest-VolumesTransfersV357Test-793391911 None] Created volume successfully. Nov 05 08:33:01 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 1073741824" returned: 0 in 0.568s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:01 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 Nov 05 08:33:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:01 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:02 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68" returned: 0 in 0.586s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (900784d8-93a7-494d-8d19-a32095912877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa9fe5-3257-42bd-a4d0-3d44b76fb600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Volume volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 (e4f49e21-f678-4a0f-b602-76f37f6a0d68): created successfully Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa9fe5-3257-42bd-a4d0-3d44b76fb600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Flow 'volume_create_manager' (173f0ba0-670f-4758-81f2-504d12fdd54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a7e45680-071f-4310-a532-fa3711d26c6b tempest-VolumesListTestJSON-1825802753 None] Created volume successfully. Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "cinder-d8ccf810-3837-41dc-8985-9910a4e0fd37-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-d8ccf810-3837-41dc-8985-9910a4e0fd37-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "cinder-quobyte-d8ccf810-3837-41dc-8985-9910a4e0fd37" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-quobyte-d8ccf810-3837-41dc-8985-9910a4e0fd37" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6c358-1765-4a9c-a535-af04a6deb5bd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:02 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 Nov 05 08:33:02 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:03 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37" returned: 0 in 0.516s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:03 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37 Nov 05 08:33:03 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:03 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d8ccf810-3837-41dc-8985-9910a4e0fd37" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-quobyte-d8ccf810-3837-41dc-8985-9910a4e0fd37" released by "delete_volume" :: held 0.988s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Created reservations ['08e6c8f0-5bd3-4d11-b9f6-87d560cd5a43', 'faed25ae-32a5-4e76-bafa-0b324265455f', '7892b400-c996-42fd-8236-14c97cc8a875', '1c580a95-f853-4c91-bef1-021a0cf24602'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:04 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:04 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:04 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.457s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Deleted volume successfully. Nov 05 08:33:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c42f16d1-be8a-45b6-b693-a037516a1099 tempest-VolumesTransfersV357Test-316695593 None] Lock "cinder-d8ccf810-3837-41dc-8985-9910a4e0fd37-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-e4f49e21-f678-4a0f-b602-76f37f6a0d68-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-e4f49e21-f678-4a0f-b602-76f37f6a0d68-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-quobyte-e4f49e21-f678-4a0f-b602-76f37f6a0d68" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-e4f49e21-f678-4a0f-b602-76f37f6a0d68" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b804822-1d78-4a7b-810a-6e4d5836a7f3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:07 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 Nov 05 08:33:07 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:07 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68" returned: 0 in 0.554s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:07 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68 Nov 05 08:33:07 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:07 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e4f49e21-f678-4a0f-b602-76f37f6a0d68" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-e4f49e21-f678-4a0f-b602-76f37f6a0d68" released by "delete_volume" :: held 0.913s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Created reservations ['5c5085ca-8f7b-4684-913e-1c765b6ba9ee', '76035c19-6bbf-4212-aa09-1b2c1139f2c2', '3dc3ce6b-d48c-448c-8bf9-e08cf059c78a', '533cb0d5-814a-4e9a-a065-b98dada0fcc7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:08 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:08 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:08 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Deleted volume successfully. Nov 05 08:33:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fa9b9f89-fae1-45e9-87fb-a99e8396e6f3 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-e4f49e21-f678-4a0f-b602-76f37f6a0d68-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-1a6c7de5-aa80-422e-8601-d408021100a0-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-1a6c7de5-aa80-422e-8601-d408021100a0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-quobyte-1a6c7de5-aa80-422e-8601-d408021100a0" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-1a6c7de5-aa80-422e-8601-d408021100a0" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040222c-86fe-420c-abf7-7e489e890703]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:09 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 Nov 05 08:33:09 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:10 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0" returned: 0 in 0.533s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:10 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0 Nov 05 08:33:10 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:10 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a6c7de5-aa80-422e-8601-d408021100a0" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-1a6c7de5-aa80-422e-8601-d408021100a0" released by "delete_volume" :: held 1.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Created reservations ['e01f7014-1128-4c1e-a692-abd38003967d', '6b88b4a3-81e7-4170-a91d-79c63a261d2a', '455c7f90-9bba-43c6-b9ef-0932bdeea5ff', 'fc554ec1-297b-46c2-a09a-b4e1960d4e1a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:10 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:10 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:11 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.531s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Deleted volume successfully. Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89bbf7a2-b45d-4f7d-a33c-98a9922fa3c2 tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-1a6c7de5-aa80-422e-8601-d408021100a0-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-1cad1b1c-4d52-4630-b7cf-d367cbd097d7-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-1cad1b1c-4d52-4630-b7cf-d367cbd097d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "cinder-quobyte-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426a869-705e-40f9-a72b-29ab9c773668]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:12 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 Nov 05 08:33:12 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:12 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:12 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7 Nov 05 08:33:12 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:12 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-quobyte-1cad1b1c-4d52-4630-b7cf-d367cbd097d7" released by "delete_volume" :: held 1.040s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Created reservations ['07630be0-834d-4f9f-bd12-c6e75a798974', '654122e6-6b09-4a48-9d06-5ea9498636ee', '394e485f-37c7-4979-989e-ee86148c4fe0', '0e2179d8-3bad-4f1b-8016-a5d1384706bc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:13 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:13 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:13 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Deleted volume successfully. Nov 05 08:33:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9c2b4d20-328b-454b-9287-a27a9c75df4f tempest-VolumesListTestJSON-1825802753 None] Lock "cinder-1cad1b1c-4d52-4630-b7cf-d367cbd097d7-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:18 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:18 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:18 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:33:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Flow 'volume_create_manager' (3a24da02-8576-459f-937a-295076f5f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c0b5c4-45d8-4194-8c74-534475bc5f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c0b5c4-45d8-4194-8c74-534475bc5f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be69690-2406-44c6-af3a-69d4050208d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef18ef1eb3d492e83466ff8441a8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:19Z,use_quota=True,user_id='9457ffb8232a4c43928c80c5183ad760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798b2a5-e273-438b-ba07-d54c98680001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c798b2a5-e273-438b-ba07-d54c98680001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e11af36-ee37-46c7-9a99-e21b9817f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e11af36-ee37-46c7-9a99-e21b9817f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7be69690-2406-44c6-af3a-69d4050208d8', 'volume_name': 'volume-7be69690-2406-44c6-af3a-69d4050208d8', 'volume_size': 1, 'image_id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd21fc96343bd77ad2498c10dd2d79b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cef18ef1eb3d492e83466ff8441a8110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '673d0336953eab71c7e6fcad8931a37d5b2a4d571b691d2f83c318d21469893f432bb8d99b9a08cbe58339e7dec0bf306c6e039f3d2543dec96a739d40fe79b2', 'id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'created_at': datetime.datetime(2026, 11, 5, 7, 33, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 33, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782340d2-4958-4be1-a1e8-2324a522a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782340d2-4958-4be1-a1e8-2324a522a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd5b16-b05f-4b24-aeaa-2150196efd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Volume 7be69690-2406-44c6-af3a-69d4050208d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7be69690-2406-44c6-af3a-69d4050208d8', 'volume_size': 1, 'image_id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd21fc96343bd77ad2498c10dd2d79b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cef18ef1eb3d492e83466ff8441a8110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '673d0336953eab71c7e6fcad8931a37d5b2a4d571b691d2f83c318d21469893f432bb8d99b9a08cbe58339e7dec0bf306c6e039f3d2543dec96a739d40fe79b2', 'id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'created_at': datetime.datetime(2026, 11, 5, 7, 33, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 33, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c/file', 'properties': {}}, 'image_service': } Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Trying to clone 7be69690-2406-44c6-af3a-69d4050208d8 from image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c at location (None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:33:19 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:33:19 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a896d9-cf16-4595-910b-34fccee273f8]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:20 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:20 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:20 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:20 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:20 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:20 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Temporary image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c is fetched for user 9457ffb8232a4c43928c80c5183ad760. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d586f061-aa50-4df4-b210-5f9ad224d78c]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:21 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:21 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:21 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:21 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:21 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:21 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be69690-2406-44c6-af3a-69d4050208d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef18ef1eb3d492e83466ff8441a8110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:19Z,use_quota=True,user_id='9457ffb8232a4c43928c80c5183ad760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Creating volume 7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:33:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:21 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1073741824 Nov 05 08:33:21 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:22 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1073741824" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:22 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 Nov 05 08:33:22 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:22 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Attempting download of 91a6bc9d-2ec3-4812-bf6c-afa5e976856c ((None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}])) to volume 7be69690-2406-44c6-af3a-69d4050208d8. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[179db79f-4376-4412-8230-1027325a9068]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:22 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o Nov 05 08:33:22 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:23 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:23 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o Nov 05 08:33:23 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:23 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o" returned: 1 in 0.421s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_uibram6o' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5370a33-d96d-411e-aaf2-805d8c905998]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:23 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:23 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:23 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:24 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD Nov 05 08:33:24 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:24 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] 91a6bc9d-2ec3-4812-bf6c-afa5e976856c was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:24 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 Nov 05 08:33:24 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:24 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8" returned: 0 in 0.638s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_91a6bc9d-2ec3-4812-bf6c-afa5e976856c_6xknr6e3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:33:24 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:33:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:24 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1G Nov 05 08:33:24 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:25 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 1G" returned: 0 in 0.477s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Downloaded image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c ((None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}])) to volume 7be69690-2406-44c6-af3a-69d4050208d8 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Temporary image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c for user 9457ffb8232a4c43928c80c5183ad760 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Marking volume 7be69690-2406-44c6-af3a-69d4050208d8 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Copying metadata from image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c to 7be69690-2406-44c6-af3a-69d4050208d8. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Creating volume glance metadata for volume 7be69690-2406-44c6-af3a-69d4050208d8 backed by image 91a6bc9d-2ec3-4812-bf6c-afa5e976856c with: {'image_id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dd21fc96343bd77ad2498c10dd2d79b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd5b16-b05f-4b24-aeaa-2150196efd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be69690-2406-44c6-af3a-69d4050208d8', 'volume_size': 1, 'image_id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd21fc96343bd77ad2498c10dd2d79b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cef18ef1eb3d492e83466ff8441a8110', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '673d0336953eab71c7e6fcad8931a37d5b2a4d571b691d2f83c318d21469893f432bb8d99b9a08cbe58339e7dec0bf306c6e039f3d2543dec96a739d40fe79b2', 'id': '91a6bc9d-2ec3-4812-bf6c-afa5e976856c', 'created_at': datetime.datetime(2026, 11, 5, 7, 33, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 33, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91a6bc9d-2ec3-4812-bf6c-afa5e976856c/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9bfeda-bf55-4bd5-bb17-58d06f403cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Volume volume-7be69690-2406-44c6-af3a-69d4050208d8 (7be69690-2406-44c6-af3a-69d4050208d8): created successfully Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9bfeda-bf55-4bd5-bb17-58d06f403cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Flow 'volume_create_manager' (3a24da02-8576-459f-937a-295076f5f36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-03bfec73-353b-43b9-a2e3-f9d2532c45a6 tempest-VolumeImageDependencyTests-307426381 None] Created volume successfully. Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Acquiring lock "cinder-7be69690-2406-44c6-af3a-69d4050208d8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "cinder-7be69690-2406-44c6-af3a-69d4050208d8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Acquiring lock "cinder-quobyte-7be69690-2406-44c6-af3a-69d4050208d8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "cinder-quobyte-7be69690-2406-44c6-af3a-69d4050208d8" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[294eb000-94be-47f9-9df1-2f4a29a1c559]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:27 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 Nov 05 08:33:27 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:27 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8" returned: 0 in 0.487s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:27 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8 Nov 05 08:33:27 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:28 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7be69690-2406-44c6-af3a-69d4050208d8" returned: 0 in 0.478s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "cinder-quobyte-7be69690-2406-44c6-af3a-69d4050208d8" released by "delete_volume" :: held 1.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Flow 'volume_create_manager' (a4bfb82b-5c8a-4ae9-bda5-faf4bd3c577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6883da-8fc3-4260-b06e-810caae846e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Created reservations ['35c5710a-ff96-437b-9a70-4baef0ad21b5', '75dd5cd9-9d7a-4e54-8b73-6df2d3bab168', '6cdee60c-99e9-456d-854b-8bfc08ca3deb', 'fa3a72b3-4688-4c64-b3cf-fc645dfb0694'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6883da-8fc3-4260-b06e-810caae846e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135046126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bca8be-90bb-4c50-ab1e-d9e4ae87f132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81fa96f507141afa7c5718321110ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:28Z,use_quota=True,user_id='88bb46a00c124790b6409bc617b07fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa292b7b-bbd2-4e5c-9d9d-76d8a931bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa292b7b-bbd2-4e5c-9d9d-76d8a931bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c341d0-39e0-4166-b527-1820583ff035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c341d0-39e0-4166-b527-1820583ff035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bca8be-90bb-4c50-ab1e-d9e4ae87f132', 'volume_name': 'volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94e71b3-575c-46e5-bb31-eba07ab7dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94e71b3-575c-46e5-bb31-eba07ab7dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0dfdd1-47e7-4ae8-8583-a12f98a66b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132', 'volume_size': 1} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-135046126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bca8be-90bb-4c50-ab1e-d9e4ae87f132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81fa96f507141afa7c5718321110ff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:28Z,use_quota=True,user_id='88bb46a00c124790b6409bc617b07fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Creating volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:28 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 1073741824 Nov 05 08:33:28 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:28 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:28 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:28 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Deleted volume successfully. Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-96031ac9-0ffa-4db6-b2b3-6fe3f3b764fc tempest-VolumeImageDependencyTests-307426381 None] Lock "cinder-7be69690-2406-44c6-af3a-69d4050208d8-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:29 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 1073741824" returned: 0 in 0.573s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:29 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:33:29 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:29 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0dfdd1-47e7-4ae8-8583-a12f98a66b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedf2a49-ced4-4c44-ad06-d88c989cf589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Volume volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 (b2bca8be-90bb-4c50-ab1e-d9e4ae87f132): created successfully Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedf2a49-ced4-4c44-ad06-d88c989cf589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Flow 'volume_create_manager' (a4bfb82b-5c8a-4ae9-bda5-faf4bd3c577e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-90979cf7-4447-4508-a035-733fb78bfe53 tempest-VolumesActionsTest-938692511 None] Created volume successfully. Nov 05 08:33:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cfc90332-badb-4f68-96ce-030eb52dee25 req-e3fb97a3-5c3c-472e-80d6-cd653efad724 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cfc90332-badb-4f68-96ce-030eb52dee25 req-e3fb97a3-5c3c-472e-80d6-cd653efad724 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-cfc90332-badb-4f68-96ce-030eb52dee25 req-e3fb97a3-5c3c-472e-80d6-cd653efad724 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:31 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-cfc90332-badb-4f68-96ce-030eb52dee25 req-e3fb97a3-5c3c-472e-80d6-cd653efad724 tempest-TestServerVolumeAttachmentScenario-836203038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-d3a718f7-e232-41d1-867b-1a8adceae42a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebebe36d-6905-4af6-9271-6a90ca02d78b', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:33:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-cfc90332-badb-4f68-96ce-030eb52dee25 req-e3fb97a3-5c3c-472e-80d6-cd653efad724 tempest-TestServerVolumeAttachmentScenario-836203038 None] attachment_update completed successfully. Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Flow 'volume_create_manager' (0148185e-b0a0-4516-929c-e7332ec934b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b0404c-406b-41e5-99fe-9be35287cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b0404c-406b-41e5-99fe-9be35287cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779962886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d71ee97-d3e5-46db-8cda-7cefd5586658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38c2e812974858b1b42bd94f528c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:35Z,use_quota=True,user_id='957a78274891469eba74dbb2a076c0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b09c7-60ce-4459-a0aa-c8422a7fdaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040b09c7-60ce-4459-a0aa-c8422a7fdaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb15c45-26b3-417e-af99-0222f2d47631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb15c45-26b3-417e-af99-0222f2d47631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d71ee97-d3e5-46db-8cda-7cefd5586658', 'volume_name': 'volume-0d71ee97-d3e5-46db-8cda-7cefd5586658', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7263bfa-b7af-4752-b338-62add4534cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7263bfa-b7af-4752-b338-62add4534cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c635d9-93af-4a7e-b6be-dca36b452fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Volume 0d71ee97-d3e5-46db-8cda-7cefd5586658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d71ee97-d3e5-46db-8cda-7cefd5586658', 'volume_size': 1} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779962886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d71ee97-d3e5-46db-8cda-7cefd5586658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38c2e812974858b1b42bd94f528c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:35Z,use_quota=True,user_id='957a78274891469eba74dbb2a076c0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Creating volume 0d71ee97-d3e5-46db-8cda-7cefd5586658 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:35 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:33:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:35 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 1073741824 Nov 05 08:33:35 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:36 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 1073741824" returned: 0 in 0.633s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:36 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 Nov 05 08:33:36 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:36 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c635d9-93af-4a7e-b6be-dca36b452fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d71ee97-d3e5-46db-8cda-7cefd5586658', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17cb883-8f02-4dc6-b184-a08753459ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Volume volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 (0d71ee97-d3e5-46db-8cda-7cefd5586658): created successfully Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17cb883-8f02-4dc6-b184-a08753459ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Flow 'volume_create_manager' (0148185e-b0a0-4516-929c-e7332ec934b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:36 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-476f8102-1d48-48bb-99dc-8254d5d798b9 tempest-ProjectReaderTests-2096416188 None] Created volume successfully. Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Acquiring lock "cinder-0d71ee97-d3e5-46db-8cda-7cefd5586658-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "cinder-0d71ee97-d3e5-46db-8cda-7cefd5586658-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Acquiring lock "cinder-quobyte-0d71ee97-d3e5-46db-8cda-7cefd5586658" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "cinder-quobyte-0d71ee97-d3e5-46db-8cda-7cefd5586658" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc647787-d949-4ec2-b74a-5a4c313d5af1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:38 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 Nov 05 08:33:38 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf83b017-7694-4dc1-a1ee-5e1fb15cb7dd req-3fffabaf-e003-46c8-9530-c518c81534f0 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf83b017-7694-4dc1-a1ee-5e1fb15cb7dd req-3fffabaf-e003-46c8-9530-c518c81534f0 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf83b017-7694-4dc1-a1ee-5e1fb15cb7dd req-3fffabaf-e003-46c8-9530-c518c81534f0 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-bf83b017-7694-4dc1-a1ee-5e1fb15cb7dd req-3fffabaf-e003-46c8-9530-c518c81534f0 tempest-TestServerVolumeAttachmentScenario-836203038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-709e91b0-2407-40c2-af61-8b83b276a79f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5192bae-1d96-489b-9b6d-a05ed2390c19', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:33:38 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:39 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658 Nov 05 08:33:39 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-bf83b017-7694-4dc1-a1ee-5e1fb15cb7dd req-3fffabaf-e003-46c8-9530-c518c81534f0 tempest-TestServerVolumeAttachmentScenario-836203038 None] attachment_update completed successfully. Nov 05 08:33:39 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0d71ee97-d3e5-46db-8cda-7cefd5586658" returned: 0 in 0.545s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "cinder-quobyte-0d71ee97-d3e5-46db-8cda-7cefd5586658" released by "delete_volume" :: held 1.157s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Created reservations ['bc1169ab-6209-4a2b-b098-cf0ab0606b36', 'decf7b10-4d00-49be-b33a-6dfaa7af1ae5', '6cdf217b-95c4-4e4c-9dbb-8ae0e7243523', '18042dad-9373-46a2-a025-81c0a1ecf621'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:39 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:39 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:40 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.548s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Deleted volume successfully. Nov 05 08:33:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7791bc81-2926-4779-8bd1-c764e09caa6a tempest-ProjectReaderTests-2096416188 None] Lock "cinder-0d71ee97-d3e5-46db-8cda-7cefd5586658-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-721f111a-9bd5-4562-98cb-13c4d5ae8a44 tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Flow 'volume_create_manager' (57f962ed-0ca2-4e27-9122-03dc825bfed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11763bae-6ce4-4cc8-9afb-f07d4318f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11763bae-6ce4-4cc8-9afb-f07d4318f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093760129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc626cbd-6f62-452a-b455-c3bb8adb7630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38c2e812974858b1b42bd94f528c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:42Z,use_quota=True,user_id='957a78274891469eba74dbb2a076c0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2826cb-9ed6-49e1-a86e-51d773e61074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2826cb-9ed6-49e1-a86e-51d773e61074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6da19c-82e7-4d0d-bc00-c3856975b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6da19c-82e7-4d0d-bc00-c3856975b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc626cbd-6f62-452a-b455-c3bb8adb7630', 'volume_name': 'volume-cc626cbd-6f62-452a-b455-c3bb8adb7630', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678359ed-5c51-46f8-9bc5-c12877adf03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678359ed-5c51-46f8-9bc5-c12877adf03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea875bef-c83c-4105-8030-8209d9fb11e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Volume cc626cbd-6f62-452a-b455-c3bb8adb7630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc626cbd-6f62-452a-b455-c3bb8adb7630', 'volume_size': 1} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093760129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc626cbd-6f62-452a-b455-c3bb8adb7630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38c2e812974858b1b42bd94f528c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:33:42Z,use_quota=True,user_id='957a78274891469eba74dbb2a076c0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Creating volume cc626cbd-6f62-452a-b455-c3bb8adb7630 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:33:41 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-721f111a-9bd5-4562-98cb-13c4d5ae8a44 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" acquired by "attach_volume" :: waited 0.143s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:41 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 1073741824 Nov 05 08:33:41 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-721f111a-9bd5-4562-98cb-13c4d5ae8a44 tempest-VolumesActionsTest-938692511 None] Attaching volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 to instance 4cc39b6f-9da2-4acd-b026-2601e18c864f at mountpoint /dev/vdb on host None. Nov 05 08:33:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-721f111a-9bd5-4562-98cb-13c4d5ae8a44 tempest-VolumesActionsTest-938692511 None] Attach volume completed successfully. Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-721f111a-9bd5-4562-98cb-13c4d5ae8a44 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" released by "attach_volume" :: held 0.154s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-68a7b755-cae0-41ae-a2f0-9294df975c0b req-4dc044ed-b895-47fc-8a67-ba92c618db95 tempest-TestServerVolumeAttachmentScenario-836203038 None] Terminate volume connection completed successfully. Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-68a7b755-cae0-41ae-a2f0-9294df975c0b req-4dc044ed-b895-47fc-8a67-ba92c618db95 tempest-TestServerVolumeAttachmentScenario-836203038 None] Deleting attachment a5192bae-1d96-489b-9b6d-a05ed2390c19. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9c63eac-ed8a-4e08-a456-73a9aa8a186e tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9c63eac-ed8a-4e08-a456-73a9aa8a186e tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9c63eac-ed8a-4e08-a456-73a9aa8a186e tempest-VolumesActionsTest-938692511 None] Detaching volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 from instance 4cc39b6f-9da2-4acd-b026-2601e18c864f. Nov 05 08:33:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b9c63eac-ed8a-4e08-a456-73a9aa8a186e tempest-VolumesActionsTest-938692511 None] Detach volume completed successfully. Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b9c63eac-ed8a-4e08-a456-73a9aa8a186e tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:42 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 1073741824" returned: 0 in 1.085s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:43 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 Nov 05 08:33:43 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:43 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630" returned: 0 in 0.445s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea875bef-c83c-4105-8030-8209d9fb11e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc626cbd-6f62-452a-b455-c3bb8adb7630', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b03f97a-2b0a-4272-86d7-cb5f0de3e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:33:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Volume volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 (cc626cbd-6f62-452a-b455-c3bb8adb7630): created successfully Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b03f97a-2b0a-4272-86d7-cb5f0de3e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Flow 'volume_create_manager' (57f962ed-0ca2-4e27-9122-03dc825bfed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:33:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-487208ce-b2f5-436a-94e1-1eaa8cdccc37 tempest-ProjectReaderTests-2096416188 None] Created volume successfully. Nov 05 08:33:43 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=79,cinder:UPDATE=99,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=97,cinder:UPDATE=109,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:33:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-145ce880-adea-4494-8c5b-4271cc52ea7c req-3b914b79-bb4d-44eb-afd1-7ff1cd996e91 tempest-TestServerVolumeAttachmentScenario-836203038 None] Terminate volume connection completed successfully. Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-145ce880-adea-4494-8c5b-4271cc52ea7c req-3b914b79-bb4d-44eb-afd1-7ff1cd996e91 tempest-TestServerVolumeAttachmentScenario-836203038 None] Deleting attachment ebebe36d-6905-4af6-9271-6a90ca02d78b. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "cinder-cc626cbd-6f62-452a-b455-c3bb8adb7630-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "cinder-cc626cbd-6f62-452a-b455-c3bb8adb7630-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "cinder-quobyte-cc626cbd-6f62-452a-b455-c3bb8adb7630" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "cinder-quobyte-cc626cbd-6f62-452a-b455-c3bb8adb7630" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bded0af-6947-4661-b1c0-58af5bce7859]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:44 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 Nov 05 08:33:44 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:44 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630" returned: 0 in 0.564s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:44 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630 Nov 05 08:33:44 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:45 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-cc626cbd-6f62-452a-b455-c3bb8adb7630" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "cinder-quobyte-cc626cbd-6f62-452a-b455-c3bb8adb7630" released by "delete_volume" :: held 0.983s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Created reservations ['433554f9-8c92-4248-8667-95bc11f4089a', '8140c674-2dd1-466a-a194-5e2051b9892c', 'a92b91ba-021a-4297-9bdb-bd42483e0599', '3ab63bd3-68b8-4b33-91df-39726654bdb8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:45 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:45 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:45 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.505s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Deleted volume successfully. Nov 05 08:33:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8530ed55-bafd-4625-9145-95eb751db203 tempest-ProjectReaderTests-2096416188 None] Lock "cinder-cc626cbd-6f62-452a-b455-c3bb8adb7630-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "cinder-709e91b0-2407-40c2-af61-8b83b276a79f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-709e91b0-2407-40c2-af61-8b83b276a79f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "cinder-quobyte-709e91b0-2407-40c2-af61-8b83b276a79f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-quobyte-709e91b0-2407-40c2-af61-8b83b276a79f" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219f962-764d-44fc-9479-1eb965e3cb8f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:50 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f Nov 05 08:33:50 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:50 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:50 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f Nov 05 08:33:50 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:50 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-709e91b0-2407-40c2-af61-8b83b276a79f" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-quobyte-709e91b0-2407-40c2-af61-8b83b276a79f" released by "delete_volume" :: held 0.912s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Created reservations ['3887ee20-109a-416c-961e-22ac9bf3adee', 'c606c423-1e5f-426f-852d-fa8ae56d6c1d', 'f84f667b-02ac-43eb-81ae-dd06581c9b89', '13b92510-afed-408e-838d-c98940bafde7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:51 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:51 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "cinder-d3a718f7-e232-41d1-867b-1a8adceae42a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-d3a718f7-e232-41d1-867b-1a8adceae42a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "cinder-quobyte-d3a718f7-e232-41d1-867b-1a8adceae42a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-quobyte-d3a718f7-e232-41d1-867b-1a8adceae42a" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92317c4-af19-4451-a27e-b46f405977d3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:51 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.454s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Deleted volume successfully. Nov 05 08:33:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-404cb055-6151-4406-9f72-20fc8a215051 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-709e91b0-2407-40c2-af61-8b83b276a79f-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:51 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a Nov 05 08:33:51 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:52 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a" returned: 0 in 0.613s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:52 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a Nov 05 08:33:52 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:52 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3a718f7-e232-41d1-867b-1a8adceae42a" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-quobyte-d3a718f7-e232-41d1-867b-1a8adceae42a" released by "delete_volume" :: held 1.152s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Created reservations ['83cc2017-22ab-4e92-89cb-354e4e3b773e', 'aa45031e-cd3f-485d-b101-1bc409a58efa', '4002ea77-5a48-465b-8fc8-ef1576b8cd31', '52bc5448-1b49-42d4-93be-f8584c85869e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:33:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:33:52 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:33:52 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:33:53 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Nov 05 08:33:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:33:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:33:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Deleted volume successfully. Nov 05 08:33:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2591f7f7-b064-4b22-a1d8-a8e558af5df5 tempest-TestServerVolumeAttachmentScenario-836203038 None] Lock "cinder-d3a718f7-e232-41d1-867b-1a8adceae42a-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7d06e75-26e3-47d7-bdbd-9c95d2f537e0 tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" by "attach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7d06e75-26e3-47d7-bdbd-9c95d2f537e0 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" acquired by "attach_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a7d06e75-26e3-47d7-bdbd-9c95d2f537e0 tempest-VolumesActionsTest-938692511 None] Attaching volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 to instance 8740bfff-060e-4edf-a616-53c92f85788e at mountpoint /dev/vdb on host None. Nov 05 08:34:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a7d06e75-26e3-47d7-bdbd-9c95d2f537e0 tempest-VolumesActionsTest-938692511 None] Attach volume completed successfully. Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a7d06e75-26e3-47d7-bdbd-9c95d2f537e0 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" released by "attach_volume" :: held 0.102s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81e9974c-8d54-4796-a9f8-e21f455f6995 tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" by "detach_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81e9974c-8d54-4796-a9f8-e21f455f6995 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-81e9974c-8d54-4796-a9f8-e21f455f6995 tempest-VolumesActionsTest-938692511 None] Detaching volume b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 from instance 8740bfff-060e-4edf-a616-53c92f85788e. Nov 05 08:34:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-81e9974c-8d54-4796-a9f8-e21f455f6995 tempest-VolumesActionsTest-938692511 None] Detach volume completed successfully. Nov 05 08:34:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-81e9974c-8d54-4796-a9f8-e21f455f6995 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[88299712-a178-4458-9704-2c189b106aa3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:12 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:12 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:12 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.607s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c65fd-7935-4b16-85e2-224eb2fd1b1a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:13 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:13 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:13 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.f821bfb5-ba1e-4799-a2b5-e03729700f9c6tl4y71x.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:13 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.f821bfb5-ba1e-4799-a2b5-e03729700f9c6tl4y71x.img Nov 05 08:34:13 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:18 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:34:18 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:18 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.714s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:19 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:34:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:34:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:34:22 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:34:25 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.f821bfb5-ba1e-4799-a2b5-e03729700f9c6tl4y71x.img" returned: 0 in 12.552s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:25 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ba40c-df30-47f1-b618-0b8a3ca97d22]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:26 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:26 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:26 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.668s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132, size 1024.00 MB, duration 12.55 sec, destination /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.f821bfb5-ba1e-4799-a2b5-e03729700f9c6tl4y71x.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:26 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Converted 1024.00 MB image at 81.57 MB/s Nov 05 08:34:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] f821bfb5-ba1e-4799-a2b5-e03729700f9c was raw, no need to convert to raw {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Flow 'volume_create_manager' (1b7b0dea-fc32-4238-a92c-341a5b00080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc68bb1-945a-4cb7-a792-9a8cb23953c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc68bb1-945a-4cb7-a792-9a8cb23953c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba83eaab-ac4f-41cf-ac34-2e2f424d550c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8f5259e52e4fc59e822c8d45f38aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:28Z,use_quota=True,user_id='4fa4238010a049a0b7807c0afbaf8ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ef63629-e02a-4359-930b-503525dddd0c),volume_type_id=6ef63629-e02a-4359-930b-503525dddd0c)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e62600f-30a9-451d-850d-7eab544326bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e62600f-30a9-451d-850d-7eab544326bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696270a5-15fe-43e3-9802-3c12131224ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696270a5-15fe-43e3-9802-3c12131224ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba83eaab-ac4f-41cf-ac34-2e2f424d550c', 'volume_name': 'volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c', 'volume_size': 1, 'image_id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '437d22309d5d2fdd83d2d98fdc8db606', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8f5259e52e4fc59e822c8d45f38aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd416a74341366b898405dc723c2d99b500bb7315e322065a7a22ca49c4ea4087a70cc33e96c47dc3017c64098850603519d703ccd1a0594ededd1b9be99e601a', 'id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'created_at': datetime.datetime(2026, 11, 5, 7, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ea4b1e-251e-4668-98f6-238a94df16d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9dceac-f9af-4850-ab89-eab08c41a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9dceac-f9af-4850-ab89-eab08c41a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6044c8-268b-4f62-b4c6-e202a4f99a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c', 'volume_size': 1, 'image_id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '437d22309d5d2fdd83d2d98fdc8db606', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8f5259e52e4fc59e822c8d45f38aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd416a74341366b898405dc723c2d99b500bb7315e322065a7a22ca49c4ea4087a70cc33e96c47dc3017c64098850603519d703ccd1a0594ededd1b9be99e601a', 'id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'created_at': datetime.datetime(2026, 11, 5, 7, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ea4b1e-251e-4668-98f6-238a94df16d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Trying to clone ba83eaab-ac4f-41cf-ac34-2e2f424d550c from image 04ea4b1e-251e-4668-98f6-238a94df16d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:34:28 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:34:28 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[beecaa92-2656-439e-ab08-086809cc48de]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:29 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:29 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:29 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:29 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:29 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:29 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:29 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Temporary image 04ea4b1e-251e-4668-98f6-238a94df16d8 is fetched for user 4fa4238010a049a0b7807c0afbaf8ae5. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f066c-58b5-4bfc-b5db-7aa51813fab0]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:30 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:30 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:30 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:30 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:30 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:30 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Flow 'volume_create_manager' (7beb021e-44e0-4852-913b-ae9568b0f615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697e8948-3404-4c9d-8dcd-dff3d4ef7982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697e8948-3404-4c9d-8dcd-dff3d4ef7982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2111053237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc241dec-0a86-48c0-837e-e02be3a5b37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68303392696a4f079be13c863f9ef34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:35Z,use_quota=True,user_id='0b8b494a21af45cd823bfaed3a54fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b71599-8c83-47e5-b71e-d129a3fe7fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b71599-8c83-47e5-b71e-d129a3fe7fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962311a-a7a2-450e-9400-b6f89e7a2ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962311a-a7a2-450e-9400-b6f89e7a2ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc241dec-0a86-48c0-837e-e02be3a5b37f', 'volume_name': 'volume-dc241dec-0a86-48c0-837e-e02be3a5b37f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ad5cd1-ecf8-4291-9395-c59a5e3745ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ad5cd1-ecf8-4291-9395-c59a5e3745ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09748f9-f111-462d-902c-07cb9195cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:35 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Volume dc241dec-0a86-48c0-837e-e02be3a5b37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc241dec-0a86-48c0-837e-e02be3a5b37f', 'volume_size': 1} Nov 05 08:34:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Flow 'volume_create_manager' (01ba59aa-b098-4827-ae60-421f939ab134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63640d53-8800-4cbf-9985-c1f86067db94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63640d53-8800-4cbf-9985-c1f86067db94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1815537917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7303f54c-58dd-4343-bb19-e7c730f96fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b044454a8d99496587498567029cf48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:43Z,use_quota=True,user_id='81ac9f14eb1a4819be65233612ea5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf639a8-25bc-4de7-a2ef-225f117028e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf639a8-25bc-4de7-a2ef-225f117028e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d2d568-cb56-442d-abab-392d73daf693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d2d568-cb56-442d-abab-392d73daf693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7303f54c-58dd-4343-bb19-e7c730f96fb5', 'volume_name': 'volume-7303f54c-58dd-4343-bb19-e7c730f96fb5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5bad95-1cd6-407e-a813-27e23f73c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5bad95-1cd6-407e-a813-27e23f73c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62805fb-6578-4d8c-a298-d459e60e0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Volume 7303f54c-58dd-4343-bb19-e7c730f96fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7303f54c-58dd-4343-bb19-e7c730f96fb5', 'volume_size': 1} Nov 05 08:34:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.354s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Uploaded volume to glance image-id: f821bfb5-ba1e-4799-a2b5-e03729700f9c. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.590s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba83eaab-ac4f-41cf-ac34-2e2f424d550c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c8f5259e52e4fc59e822c8d45f38aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:28Z,use_quota=True,user_id='4fa4238010a049a0b7807c0afbaf8ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ef63629-e02a-4359-930b-503525dddd0c),volume_type_id=6ef63629-e02a-4359-930b-503525dddd0c)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Creating volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:47 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1073741824 Nov 05 08:34:47 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ec4e5192-f54e-4de2-83ab-23ca912b10bd tempest-VolumesActionsTest-938692511 None] Copy volume to image completed successfully. Nov 05 08:34:47 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1073741824" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c Nov 05 08:34:48 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.964s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2111053237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc241dec-0a86-48c0-837e-e02be3a5b37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68303392696a4f079be13c863f9ef34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:35Z,use_quota=True,user_id='0b8b494a21af45cd823bfaed3a54fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Creating volume dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:48 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f 1073741824 Nov 05 08:34:48 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Attempting download of 04ea4b1e-251e-4668-98f6-238a94df16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}])) to volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[21310c07-231e-48b1-929b-5a9906c585b5]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs Nov 05 08:34:48 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f 1073741824" returned: 0 in 0.519s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:48 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs Nov 05 08:34:48 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:48 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:34:48 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs" returned: 1 in 0.322s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04ea4b1e-251e-4668-98f6-238a94df16d8_3d4gxwfs' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a4bd9c-f942-4727-b2d9-e7aa7258848e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.665s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1815537917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7303f54c-58dd-4343-bb19-e7c730f96fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b044454a8d99496587498567029cf48d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:34:43Z,use_quota=True,user_id='81ac9f14eb1a4819be65233612ea5e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Creating volume 7303f54c-58dd-4343-bb19-e7c730f96fb5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:34:49 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09748f9-f111-462d-902c-07cb9195cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc241dec-0a86-48c0-837e-e02be3a5b37f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:49 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 1073741824 Nov 05 08:34:49 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d242e83-0fc7-4875-8b8b-a8932d0b4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:49 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:49 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Volume volume-dc241dec-0a86-48c0-837e-e02be3a5b37f (dc241dec-0a86-48c0-837e-e02be3a5b37f): created successfully Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d242e83-0fc7-4875-8b8b-a8932d0b4f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Flow 'volume_create_manager' (7beb021e-44e0-4852-913b-ae9568b0f615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-faee3c96-6399-4e12-b155-8daa5a944f31 tempest-SnapshotDependencyTests-378904404 None] Created volume successfully. Nov 05 08:34:49 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD Nov 05 08:34:49 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 1073741824" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 Nov 05 08:34:49 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] 04ea4b1e-251e-4668-98f6-238a94df16d8 was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c Nov 05 08:34:49 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:49 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.715s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62805fb-6578-4d8c-a298-d459e60e0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7303f54c-58dd-4343-bb19-e7c730f96fb5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca1b1ba-1a41-40dc-aa7c-b52ba56a4469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27581b-9a51-4af6-814e-8d9c14f4c9c8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Volume volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 (7303f54c-58dd-4343-bb19-e7c730f96fb5): created successfully Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca1b1ba-1a41-40dc-aa7c-b52ba56a4469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Flow 'volume_create_manager' (01ba59aa-b098-4827-ae60-421f939ab134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-01d5b477-5717-417c-a5da-4ec9783e0601 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Created volume successfully. Nov 05 08:34:50 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:50 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04ea4b1e-251e-4668-98f6-238a94df16d8_irxc17aodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:50 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1G Nov 05 08:34:50 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b6083-da83-4e37-9805-7766409ab668]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:50 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:50 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c 1G" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Downloaded image 04ea4b1e-251e-4668-98f6-238a94df16d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}])) to volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Temporary image 04ea4b1e-251e-4668-98f6-238a94df16d8 for user 4fa4238010a049a0b7807c0afbaf8ae5 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Marking volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Copying metadata from image 04ea4b1e-251e-4668-98f6-238a94df16d8 to ba83eaab-ac4f-41cf-ac34-2e2f424d550c. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Creating volume glance metadata for volume ba83eaab-ac4f-41cf-ac34-2e2f424d550c backed by image 04ea4b1e-251e-4668-98f6-238a94df16d8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '437d22309d5d2fdd83d2d98fdc8db606', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6044c8-268b-4f62-b4c6-e202a4f99a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c', 'volume_size': 1, 'image_id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04ea4b1e-251e-4668-98f6-238a94df16d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '437d22309d5d2fdd83d2d98fdc8db606', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c8f5259e52e4fc59e822c8d45f38aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd416a74341366b898405dc723c2d99b500bb7315e322065a7a22ca49c4ea4087a70cc33e96c47dc3017c64098850603519d703ccd1a0594ededd1b9be99e601a', 'id': '04ea4b1e-251e-4668-98f6-238a94df16d8', 'created_at': datetime.datetime(2026, 11, 5, 7, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04ea4b1e-251e-4668-98f6-238a94df16d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9b9686-7ab9-4bd7-8edd-34dbc9f4fbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:34:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Volume volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c (ba83eaab-ac4f-41cf-ac34-2e2f424d550c): created successfully Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9b9686-7ab9-4bd7-8edd-34dbc9f4fbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Flow 'volume_create_manager' (1b7b0dea-fc32-4238-a92c-341a5b00080e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:34:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6c40cc7d-d96c-4312-bb6c-91c9ea3cd59c tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Created volume successfully. Nov 05 08:34:50 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.437s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:50 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img Nov 05 08:34:50 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Acquiring lock "cinder-ba83eaab-ac4f-41cf-ac34-2e2f424d550c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "cinder-ba83eaab-ac4f-41cf-ac34-2e2f424d550c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Acquiring lock "cinder-quobyte-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "cinder-quobyte-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98eba77-3c27-4532-b6b6-1ac907208664]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:51 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c Nov 05 08:34:51 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:51 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:51 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c Nov 05 08:34:51 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:52 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" returned: 0 in 0.747s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "cinder-quobyte-ba83eaab-ac4f-41cf-ac34-2e2f424d550c" released by "delete_volume" :: held 1.401s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:52 devstack cinder-volume[87092]: WARNING cinder.quota [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:34:52 devstack cinder-volume[87092]: WARNING cinder.quota [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:34:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f7b1e67b-06d5-4aa5-bad2-aada9fbe59be req-26c8e295-4854-4e50-9c6a-d466cc49216b tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Created reservations ['e433db29-a3bd-467a-a6d1-8ea519d0bd2f', '3d4162fe-c388-446c-8894-8b6eb66521cf', 'bcba205b-a424-470c-b188-c7a2481df981', '5e80c0c2-2e52-48dc-a117-50ad9939f803'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:53 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:34:53 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:53 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:34:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Deleted volume successfully. Nov 05 08:34:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa9fdeb4-f94f-41d7-82ff-78e12e71de57 tempest-VolumeAndVolumeTypeFromImageTest-621857121 None] Lock "cinder-ba83eaab-ac4f-41cf-ac34-2e2f424d550c-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:34:58 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img" returned: 0 in 7.664s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e702e71-e9ca-4bcf-a337-63e302ba2a9d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:58 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:34:58 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:59 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.544s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:34:59 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Converted 1024.00 MB image at 133.59 MB/s Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] 0872c380-0cc8-4a06-ac87-6221d2b5f368 was raw, converting to qcow2 {{(pid=87092) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49159c1-e13d-463b-91cb-d4c439cf020c]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:59 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img Nov 05 08:34:59 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:59 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img" returned: 0 in 0.338s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:59 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img Nov 05 08:34:59 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:34:59 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img" returned: 1 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:34:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:34:59 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y Nov 05 08:34:59 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:00 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Image conversion details: src /opt/stack/data/cinder/conversion/b2bca8be-90bb-4c50-ab1e-d9e4ae87f132.temp_image.0872c380-0cc8-4a06-ac87-6221d2b5f368vxt37v9a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:35:00 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5d4a25-6f51-44dc-a619-25aea8dd6fa1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (22f3e80f-c8f7-424f-887b-df8f5c416dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34287e0e-df91-45b3-94e2-b7872b91caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34287e0e-df91-45b3-94e2-b7872b91caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462460653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e49fe8-d5cb-4f4d-99fd-369f9819532f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:00Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83914c84-653a-4231-bd17-5bcdf866b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:00 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y Nov 05 08:35:00 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83914c84-653a-4231-bd17-5bcdf866b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c04f69-e690-40dd-9187-ec218d155179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c04f69-e690-40dd-9187-ec218d155179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e49fe8-d5cb-4f4d-99fd-369f9819532f', 'volume_name': 'volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32aff56-6108-474e-bf3c-3264a2cbd081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32aff56-6108-474e-bf3c-3264a2cbd081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249ba4e-7c72-4746-86d4-3642e300707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:00 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume c4e49fe8-d5cb-4f4d-99fd-369f9819532f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f', 'volume_size': 1} Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:00 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w0an2a7y" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.957s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Uploaded volume to glance image-id: 0872c380-0cc8-4a06-ac87-6221d2b5f368. {{(pid=87092) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.434s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Creating offline snapshot a30d331b-9f2d-469f-b624-39f5cd67b405 of volume dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-101b1f10-0227-4b02-8da7-305d0e8fcb12 tempest-VolumesActionsTest-938692511 None] Copy volume to image completed successfully. Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a39a475-4395-4ec8-afa2-ba4ddf2e064c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:35:02 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:02 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 1G Nov 05 08:35:02 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:02 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 1G" returned: 0 in 0.393s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc241dec-0a86-48c0-837e-e02be3a5b37f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc241dec-0a86-48c0-837e-e02be3a5b37f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:02 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:02 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc241dec-0a86-48c0-837e-e02be3a5b37f -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 is being set with open permissions: ugo+rw Nov 05 08:35:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:02 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:03 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info Nov 05 08:35:03 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:03 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Acquiring lock "cinder-quobyte-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info is being set with open permissions: ugo+rw Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "cinder-quobyte-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:03 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info Nov 05 08:35:03 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[70368fe2-21c3-4aa7-ae13-001644823ef1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:35:03 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.info" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f7b1e67b-06d5-4aa5-bad2-aada9fbe59be req-26c8e295-4854-4e50-9c6a-d466cc49216b tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.339s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f7b1e67b-06d5-4aa5-bad2-aada9fbe59be req-26c8e295-4854-4e50-9c6a-d466cc49216b tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.693s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462460653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e49fe8-d5cb-4f4d-99fd-369f9819532f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:00Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume c4e49fe8-d5cb-4f4d-99fd-369f9819532f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-66f9a6ae-a2b9-4c96-b8fa-1aa15322411d tempest-SnapshotDependencyTests-378904404 None] Create snapshot completed successfully Nov 05 08:35:03 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f 1073741824 Nov 05 08:35:03 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f7b1e67b-06d5-4aa5-bad2-aada9fbe59be req-26c8e295-4854-4e50-9c6a-d466cc49216b tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-7303f54c-58dd-4343-bb19-e7c730f96fb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02e0247b-7978-49e9-8b99-0db26fc62825', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:35:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f7b1e67b-06d5-4aa5-bad2-aada9fbe59be req-26c8e295-4854-4e50-9c6a-d466cc49216b tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] attachment_update completed successfully. Nov 05 08:35:04 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:04 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132 Nov 05 08:35:04 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:04 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "cinder-quobyte-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132" released by "delete_volume" :: held 0.854s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:04 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f 1073741824" returned: 0 in 0.579s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Created reservations ['50a22a0e-ca37-4a0e-bec6-1022a4a1a429', 'd2b26f4e-eccb-4aaf-b61c-b7cf061ccb3a', 'd0954d7d-68f9-40b8-9685-39e42421b008', 'a14dd6f5-476b-4e89-9604-da10e520b0e5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:04 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f Nov 05 08:35:04 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:04 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:04 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:04 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" returned: 0 in 0.445s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249ba4e-7c72-4746-86d4-3642e300707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392641e-98fa-4461-aaf9-23097fd5240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f (c4e49fe8-d5cb-4f4d-99fd-369f9819532f): created successfully Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4392641e-98fa-4461-aaf9-23097fd5240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (22f3e80f-c8f7-424f-887b-df8f5c416dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ed290d35-8503-4efd-b40e-c3c6f78c33b2 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:05 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.409s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Deleted volume successfully. Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-45c266cd-a02b-49ff-8336-f18df75a97a2 tempest-VolumesActionsTest-938692511 None] Lock "cinder-b2bca8be-90bb-4c50-ab1e-d9e4ae87f132-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Flow 'volume_create_manager' (7d93a7ff-5163-450a-a6b1-3ca619ae9598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f71a8-d376-4612-885f-e0741bfda3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f71a8-d376-4612-885f-e0741bfda3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68303392696a4f079be13c863f9ef34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a30d331b-9f2d-469f-b624-39f5cd67b405,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:05Z,use_quota=True,user_id='0b8b494a21af45cd823bfaed3a54fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4128911-0138-4e9f-9e83-8a2e3ef3def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4128911-0138-4e9f-9e83-8a2e3ef3def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5ec4f0-59df-4d58-a427-00bfa33ecdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5ec4f0-59df-4d58-a427-00bfa33ecdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1', 'volume_name': 'volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1', 'volume_size': 1, 'snapshot_id': 'a30d331b-9f2d-469f-b624-39f5cd67b405'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b8ac9-6020-43b2-9ece-b3c70b4fb662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b8ac9-6020-43b2-9ece-b3c70b4fb662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222adee8-ec62-4e19-ab07-d90eba320360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Volume 1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1', 'volume_size': 1, 'snapshot_id': 'a30d331b-9f2d-469f-b624-39f5cd67b405'} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Creating volume 1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 from snapshot a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] snapshot: a30d331b-9f2d-469f-b624-39f5cd67b405, volume: 1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eecdb51-01ef-4b7d-a644-c3e8614d7c86]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:05 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:05 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:06 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (7068f694-f391-4afd-9083-771fcedf8984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afb0d53-8845-472d-b74e-bb7c0dd9d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.589s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc241dec-0a86-48c0-837e-e02be3a5b37f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afb0d53-8845-472d-b74e-bb7c0dd9d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892257305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d276d-1401-41c6-9ce6-3b1b4e1fd4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:06Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58576ad6-4182-421c-bd3d-10aca8a61b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58576ad6-4182-421c-bd3d-10aca8a61b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1bbd52-9136-43d7-96aa-c85cafcede48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1bbd52-9136-43d7-96aa-c85cafcede48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925d276d-1401-41c6-9ce6-3b1b4e1fd4d9', 'volume_name': 'volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406f601e-48ff-47a5-bd7e-f7ade91e1f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406f601e-48ff-47a5-bd7e-f7ade91e1f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d8910a-c5e1-4385-abde-5a81b05b96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume 925d276d-1401-41c6-9ce6-3b1b4e1fd4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9', 'volume_size': 1} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7209d1f7-f53e-44fb-831a-31bb4206b1fa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:06 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:35:06 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (d950201d-ff78-44f0-a1ed-4881c46da8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f7c605-e150-42b6-ae14-200251836353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f7c605-e150-42b6-ae14-200251836353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-921654644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77c986c-6c70-4e0c-8f19-17e7b2c5ce82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:07Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854796ea-4295-401c-b773-436b84e1e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854796ea-4295-401c-b773-436b84e1e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72270ab5-0def-43f5-b77e-67d2d9d506f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72270ab5-0def-43f5-b77e-67d2d9d506f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a77c986c-6c70-4e0c-8f19-17e7b2c5ce82', 'volume_name': 'volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e659250a-f703-4c8d-9620-9d9c3a6c51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e659250a-f703-4c8d-9620-9d9c3a6c51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c29833f-b071-4418-a6ef-c9cf757c0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume a77c986c-6c70-4e0c-8f19-17e7b2c5ce82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82', 'volume_size': 1} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.735s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:07 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 Nov 05 08:35:07 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f4a9ada7-2b8e-4a82-bfb4-7d7d8bd3c591 req-83fd3351-d4c1-48b8-9f83-44c0db958165 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Terminate volume connection completed successfully. Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f4a9ada7-2b8e-4a82-bfb4-7d7d8bd3c591 req-83fd3351-d4c1-48b8-9f83-44c0db958165 tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Deleting attachment 02e0247b-7978-49e9-8b99-0db26fc62825. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (704709e6-18ef-4a98-b697-22eb3bed1860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9fbb70-8cfd-4ee6-a557-dea25cc6f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9fbb70-8cfd-4ee6-a557-dea25cc6f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203855440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2992c3-88df-42e9-a788-987230dbf272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:07Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977f8da1-bf22-453b-b5c2-1b62f9377a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977f8da1-bf22-453b-b5c2-1b62f9377a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7631f60-be0d-4eef-90d1-f00b202fc6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7631f60-be0d-4eef-90d1-f00b202fc6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2992c3-88df-42e9-a788-987230dbf272', 'volume_name': 'volume-fd2992c3-88df-42e9-a788-987230dbf272', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c41085-ca36-4d6d-92f8-6e618b0fcf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c41085-ca36-4d6d-92f8-6e618b0fcf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549354b-92f5-4b46-98fb-221e62b0125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume fd2992c3-88df-42e9-a788-987230dbf272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2992c3-88df-42e9-a788-987230dbf272', 'volume_size': 1} Nov 05 08:35:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (95ced267-4f1d-4312-9869-f89c6e58447f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc04e70-2179-4d24-8709-4080f82bf220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc04e70-2179-4d24-8709-4080f82bf220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093542379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841b8e3f-fa55-432e-8d2a-d1ae9f074981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:08Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31093d57-5449-4218-a11d-354db9647e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31093d57-5449-4218-a11d-354db9647e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35284d4-6488-4d39-9c10-6295a95b3186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35284d4-6488-4d39-9c10-6295a95b3186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841b8e3f-fa55-432e-8d2a-d1ae9f074981', 'volume_name': 'volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bffc825-8975-4c25-b12b-ccc576cb1d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bffc825-8975-4c25-b12b-ccc576cb1d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0dcb29-c685-46da-964d-95302fb0d444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume 841b8e3f-fa55-432e-8d2a-d1ae9f074981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981', 'volume_size': 1} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "cinder-7303f54c-58dd-4343-bb19-e7c730f96fb5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "cinder-7303f54c-58dd-4343-bb19-e7c730f96fb5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "cinder-quobyte-7303f54c-58dd-4343-bb19-e7c730f96fb5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "cinder-quobyte-7303f54c-58dd-4343-bb19-e7c730f96fb5" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[86302dee-686d-4b87-a08e-529c0f672d19]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:08 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 Nov 05 08:35:08 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (8b2b1fa5-59e9-47c1-bb84-541686f8dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2387c6b-a247-40ed-85b8-a001108e6227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2387c6b-a247-40ed-85b8-a001108e6227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-718452082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d7e9f9-ba4f-4d43-87b4-8b86b07919c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:09Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8901922a-e3e6-411d-aa76-a1a0b97855d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8901922a-e3e6-411d-aa76-a1a0b97855d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17c8fbf-5c08-4ff2-839f-822b813192f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17c8fbf-5c08-4ff2-839f-822b813192f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d7e9f9-ba4f-4d43-87b4-8b86b07919c3', 'volume_name': 'volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8517e79b-558d-4430-a3d8-feb6b1ba6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8517e79b-558d-4430-a3d8-feb6b1ba6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac721de-79d6-47b7-942e-a11113e34b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume 38d7e9f9-ba4f-4d43-87b4-8b86b07919c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3', 'volume_size': 1} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:09 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5" returned: 0 in 0.728s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:09 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5 Nov 05 08:35:09 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:09 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7303f54c-58dd-4343-bb19-e7c730f96fb5" returned: 0 in 0.513s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "cinder-quobyte-7303f54c-58dd-4343-bb19-e7c730f96fb5" released by "delete_volume" :: held 1.357s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Created reservations ['22edc8bd-d39f-4911-8a09-a1c249cd8b26', 'e3ab7dd7-c066-40cf-9e4b-9e0d2dc30d68', '3420b28d-bf34-4cc3-b4ce-e401ef775ff5', '8a36c1b7-26cc-4e74-915c-55baf55212d8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:10 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:10 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:10 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Deleted volume successfully. Nov 05 08:35:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-15334749-5da6-4011-978b-07f4c3ee871a tempest-TestServerVolumeAttachScenarioOldVersion-576546998 None] Lock "cinder-7303f54c-58dd-4343-bb19-e7c730f96fb5-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:16 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" returned: 0 in 9.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:35:16 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Converted 1024.00 MB image at 108.57 MB/s Nov 05 08:35:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 is being set with open permissions: ugo+rw Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:16 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 Nov 05 08:35:16 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:16 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" released by "_copy_volume_from_snapshot" :: held 11.324s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" released by "_create_volume_from_snapshot" :: held 11.420s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.444s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.591s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892257305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d276d-1401-41c6-9ce6-3b1b4e1fd4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:06Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume 925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:17 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 1073741824 Nov 05 08:35:17 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222adee8-ec62-4e19-ab07-d90eba320360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1', 'volume_size': 1, 'snapshot_id': 'a30d331b-9f2d-469f-b624-39f5cd67b405'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160fb17-f347-42d8-b01d-1127914064c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Volume volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 (1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1): created successfully Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1160fb17-f347-42d8-b01d-1127914064c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Flow 'volume_create_manager' (7d93a7ff-5163-450a-a6b1-3ca619ae9598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8f83d26c-634b-44f5-9012-d2c81ffff5f6 tempest-SnapshotDependencyTests-378904404 None] Created volume successfully. Nov 05 08:35:17 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 1073741824" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:17 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 Nov 05 08:35:17 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:17 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.648s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-921654644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a77c986c-6c70-4e0c-8f19-17e7b2c5ce82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:07Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d8910a-c5e1-4385-abde-5a81b05b96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:17 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 1073741824 Nov 05 08:35:17 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0aec6d6-a22a-43b6-9265-73e6311797c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 (925d276d-1401-41c6-9ce6-3b1b4e1fd4d9): created successfully Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0aec6d6-a22a-43b6-9265-73e6311797c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (7068f694-f391-4afd-9083-771fcedf8984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-42b81d96-a58f-470a-8c96-1b29c666913e tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-a30d331b-9f2d-469f-b624-39f5cd67b405-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:18 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:18 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-a30d331b-9f2d-469f-b624-39f5cd67b405-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Deleting offline snapshot a30d331b-9f2d-469f-b624-39f5cd67b405 of volume dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] snapshot_file for this snap is: volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:18 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 1073741824" returned: 0 in 0.676s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07e57c-da89-4ba9-819f-5b42e335161c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:18 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 Nov 05 08:35:18 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:18 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.404s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:35:18 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:18 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:18 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" returned: 0 in 0.346s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.221s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203855440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2992c3-88df-42e9-a788-987230dbf272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:07Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume fd2992c3-88df-42e9-a788-987230dbf272 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c29833f-b071-4418-a6ef-c9cf757c0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:18 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 1073741824 Nov 05 08:35:18 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8387a316-3cbb-4b04-808e-2f18637a5ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 (a77c986c-6c70-4e0c-8f19-17e7b2c5ce82): created successfully Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8387a316-3cbb-4b04-808e-2f18637a5ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (d950201d-ff78-44f0-a1ed-4881c46da8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ac04a5d9-8920-43f5-987e-53932c3e8e35 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:19 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.608s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc241dec-0a86-48c0-837e-e02be3a5b37f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5144846-7b50-42b6-ac67-95437d76591a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:35:19 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:19 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 1073741824" returned: 0 in 0.595s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 Nov 05 08:35:19 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:19 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.534s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093542379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841b8e3f-fa55-432e-8d2a-d1ae9f074981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:08Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume 841b8e3f-fa55-432e-8d2a-d1ae9f074981 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:19 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:19 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 1073741824 Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549354b-92f5-4b46-98fb-221e62b0125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2992c3-88df-42e9-a788-987230dbf272', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:19 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10300668-d605-4af3-b5d9-73e03d1450ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.787s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-fd2992c3-88df-42e9-a788-987230dbf272 (fd2992c3-88df-42e9-a788-987230dbf272): created successfully Nov 05 08:35:20 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:20 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10300668-d605-4af3-b5d9-73e03d1450ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (704709e6-18ef-4a98-b697-22eb3bed1860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4265521b-fdd0-43e3-86b4-a152a43bf812 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Flow 'volume_create_manager' (ab060cdf-e01c-420a-af4e-43230ea0beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59996d1-cb79-4f1b-af96-cde68a06fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59996d1-cb79-4f1b-af96-cde68a06fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1093150694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1769ab-4302-4462-a17f-0e3e83f41978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb1e975af1d4c4984e94050813844d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:20Z,use_quota=True,user_id='b8f4e59c75fb44acb71f2a221dce6de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd4c59f-b9bf-458b-bb2e-83da84fb584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd4c59f-b9bf-458b-bb2e-83da84fb584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5d3d3f-87a4-4f44-ab0e-f530a3d93244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5d3d3f-87a4-4f44-ab0e-f530a3d93244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1769ab-4302-4462-a17f-0e3e83f41978', 'volume_name': 'volume-bb1769ab-4302-4462-a17f-0e3e83f41978', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022161d-acaf-443a-962a-cde250add260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022161d-acaf-443a-962a-cde250add260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b845c570-23e8-400d-9cac-f27aff2df839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Volume bb1769ab-4302-4462-a17f-0e3e83f41978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1769ab-4302-4462-a17f-0e3e83f41978', 'volume_size': 1} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:20 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:20 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405 Nov 05 08:35:20 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:20 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 1073741824" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:20 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 Nov 05 08:35:20 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:20 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f.a30d331b-9f2d-469f-b624-39f5cd67b405" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-a30d331b-9f2d-469f-b624-39f5cd67b405" released by "_delete_snapshot" :: held 2.284s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" released by "delete_snapshot" :: held 2.325s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:20 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.507s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-718452082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d7e9f9-ba4f-4d43-87b4-8b86b07919c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab288f0d578c43258f0abcb460880045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:09Z,use_quota=True,user_id='250bc0b14dda4d2fb86a6536cda4e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Creating volume 38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:20 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 1073741824 Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Created reservations ['84663b76-ec3b-4fcf-87ab-3757b9b80ceb', 'cc0e1b99-b01b-4f03-a1d9-e8d216283e7f', '56cdc843-029c-403e-a71f-7cdf97cfc578', '1a632a89-988c-490c-9cd0-33fc085a4bc3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:20 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0dcb29-c685-46da-964d-95302fb0d444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cb276c-c613-4914-ab37-698b30f447f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 (841b8e3f-fa55-432e-8d2a-d1ae9f074981): created successfully Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cb276c-c613-4914-ab37-698b30f447f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (95ced267-4f1d-4312-9869-f89c6e58447f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef7f0ec6-5a81-4b20-a1c8-d999844eed59 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Delete snapshot completed successfully. Nov 05 08:35:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-92ad25dc-4006-43ad-b99e-dac400dc4d50 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-a30d331b-9f2d-469f-b624-39f5cd67b405-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:21 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 1073741824" returned: 0 in 0.531s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:21 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 Nov 05 08:35:21 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-dc241dec-0a86-48c0-837e-e02be3a5b37f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-dc241dec-0a86-48c0-837e-e02be3a5b37f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4795d4a-b5ee-44a3-a63a-65ef94148a14]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:21 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1093150694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1769ab-4302-4462-a17f-0e3e83f41978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efb1e975af1d4c4984e94050813844d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:20Z,use_quota=True,user_id='b8f4e59c75fb44acb71f2a221dce6de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Creating volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:21 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 1073741824 Nov 05 08:35:21 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac721de-79d6-47b7-942e-a11113e34b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bacdf7-6fa4-48cb-a9ce-102ea7906eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Volume volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 (38d7e9f9-ba4f-4d43-87b4-8b86b07919c3): created successfully Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bacdf7-6fa4-48cb-a9ce-102ea7906eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Flow 'volume_create_manager' (8b2b1fa5-59e9-47c1-bb84-541686f8dc43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:21 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:35:21 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e66e99ef-2a65-4d1b-83c3-eefe263a7f3c tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created volume successfully. Nov 05 08:35:22 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:22 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f Nov 05 08:35:22 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:22 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 1073741824" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:22 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 Nov 05 08:35:22 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:22 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-dc241dec-0a86-48c0-837e-e02be3a5b37f" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-dc241dec-0a86-48c0-837e-e02be3a5b37f" released by "delete_volume" :: held 0.765s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=68,cinder:INSERT=17,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Created reservations ['57341fe7-e0c5-4413-be7d-2e5f1b5ba4f2', '031b8cfc-0f5e-4b02-b5c6-104bae6b46ee', '78749747-d66a-48f5-b750-a4fae3ec83bf', '27e5d331-fb80-4ddb-a31c-cf1a91e9e59a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:22 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a1167-c389-45c5-b9c4-9f4b230643af]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:22 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:22 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b845c570-23e8-400d-9cac-f27aff2df839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1769ab-4302-4462-a17f-0e3e83f41978', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333d723-993a-41ce-bebd-13e95f2fadf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Volume volume-bb1769ab-4302-4462-a17f-0e3e83f41978 (bb1769ab-4302-4462-a17f-0e3e83f41978): created successfully Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333d723-993a-41ce-bebd-13e95f2fadf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Flow 'volume_create_manager' (ab060cdf-e01c-420a-af4e-43230ea0beda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:22 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 Nov 05 08:35:22 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6946b1eb-d9f2-444f-b91e-e5b5f30c77f2 tempest-VolumesSnapshotListTestJSON-249384471 None] Created volume successfully. Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e195f-4963-4c45-a3e7-9d4d76e49c22]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:22 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.349s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:22 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Deleted volume successfully. Nov 05 08:35:22 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 Nov 05 08:35:22 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2dc2281e-a676-462b-82d8-696731794a45 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-dc241dec-0a86-48c0-837e-e02be3a5b37f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:23 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:23 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3 Nov 05 08:35:23 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:23 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" returned: 0 in 0.499s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:23 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:23 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1 Nov 05 08:35:23 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3" released by "delete_volume" :: held 0.923s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Creating offline snapshot b20ed859-c20b-409e-9080-32b10c7ec964 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['be693c1f-5efb-4534-9e11-7929c0062025', '2f79d042-435c-414b-8660-8166624d3509', '6e059c99-09cc-495d-8228-51cba1808fb5', 'beb08af4-0000-4de0-9328-3d2e025c6afe'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda1984-e0a4-472b-bdf4-097bca215e6b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:23 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:23 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 Nov 05 08:35:23 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:23 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:23 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-quobyte-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1" released by "delete_volume" :: held 0.924s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Created reservations ['23d675ea-0dc0-4079-9f89-7ef5cca522f4', 'fdab8658-b51f-45bd-8518-41db438bb424', 'a48cf8b9-952c-4630-90de-bbb62482fd45', '930323f8-cbd6-474b-82e4-c43b20659f3c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:23 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:23 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:24 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:24 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:24 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 1G Nov 05 08:35:24 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=79,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=12 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aecbb5f0-1a32-4a24-8ec4-a432b1b1d89b tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-38d7e9f9-ba4f-4d43-87b4-8b86b07919c3-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:24 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Deleted volume successfully. Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c8074d75-39ad-4a91-87c3-86c7b8b98f46 tempest-SnapshotDependencyTests-378904404 None] Lock "cinder-1a4b8f0a-1ea7-406a-8b9b-3ba142b9c4e1-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:24 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 1G" returned: 0 in 0.454s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:24 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:24 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-841b8e3f-fa55-432e-8d2a-d1ae9f074981-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-841b8e3f-fa55-432e-8d2a-d1ae9f074981-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-841b8e3f-fa55-432e-8d2a-d1ae9f074981" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-841b8e3f-fa55-432e-8d2a-d1ae9f074981" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad867e-8905-4beb-bd96-fa1e5addb0e9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 Nov 05 08:35:25 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:25 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 is being set with open permissions: ugo+rw Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:25 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:25 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:25 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info Nov 05 08:35:25 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:25 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981 Nov 05 08:35:25 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:25 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-841b8e3f-fa55-432e-8d2a-d1ae9f074981" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:25 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info is being set with open permissions: ugo+rw Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-841b8e3f-fa55-432e-8d2a-d1ae9f074981" released by "delete_volume" :: held 0.924s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:25 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info Nov 05 08:35:25 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['8d89d465-1b33-499b-a2a9-6177f2617cb9', 'bbf48a3a-a358-4fa8-ad3f-72bf72d61629', '2b0a65d8-d4ab-4cd1-9be1-8207ef635efd', 'b959f7da-fd30-4085-a6cb-3950bc62a9e3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:25 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:25 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-fd2992c3-88df-42e9-a788-987230dbf272-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-fd2992c3-88df-42e9-a788-987230dbf272-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-fd2992c3-88df-42e9-a788-987230dbf272" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-fd2992c3-88df-42e9-a788-987230dbf272" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:26 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.info" returned: 0 in 0.532s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[856dbd61-8831-4cd3-9a6b-a04a61003db4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c69636a3-74c8-4038-96db-8b0def63aa05 tempest-VolumesSnapshotListTestJSON-249384471 None] Create snapshot completed successfully Nov 05 08:35:26 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:26 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 Nov 05 08:35:26 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ab766312-aa2a-4602-a9d6-9b229df78d47 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-841b8e3f-fa55-432e-8d2a-d1ae9f074981-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:26 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272" returned: 0 in 0.489s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:26 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272 Nov 05 08:35:26 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Creating offline snapshot 17c40c99-c288-40da-b01d-4a1d760231b1 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8ae4f-68d7-4d83-befe-1c95771738c4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:27 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-fd2992c3-88df-42e9-a788-987230dbf272" returned: 0 in 0.356s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-fd2992c3-88df-42e9-a788-987230dbf272" released by "delete_volume" :: held 0.932s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:27 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:27 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['85624828-c363-4eca-b347-19d7930d4c4b', 'f360d95d-e4b3-4389-9edf-9d9b00ac4385', '12e6fdc0-1f36-4efd-8905-26e30fd1c654', '7918bbd7-ce7e-452b-b635-71806c209355'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:27 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:27 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:27 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:27 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 1G Nov 05 08:35:27 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:27 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-35c8a6b4-333e-4c69-a54f-5f5108e253be tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-fd2992c3-88df-42e9-a788-987230dbf272-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:28 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 1G" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:28 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:28 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:28 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:28 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 is being set with open permissions: ugo+rw Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" acquired by "delete_volume" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:28 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:28 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[02677811-0707-4b62-a27f-b46fd0db980f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:28 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 Nov 05 08:35:28 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:29 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0046ee1c-e4b0-464b-b628-a0246efba055 tempest-VolumesSnapshotListTestJSON-249384471 None] Create snapshot completed successfully Nov 05 08:35:29 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" returned: 0 in 0.540s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:29 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82 Nov 05 08:35:29 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:29 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82" released by "delete_volume" :: held 0.884s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['42e76994-6045-4d9c-80d3-f0e3cec05126', '4cfa4e45-6acb-429f-a84a-72056f7fa08e', '2b51b8b4-590c-498d-b41a-e4f3c21d05f2', '0468a6b7-565e-4a6c-92c5-34fb1aa5aff1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:29 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:29 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deadb3c-54a3-46aa-a249-51ddab269116]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:30 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ef29dad6-b666-478e-bb47-b140ba482e6a tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-a77c986c-6c70-4e0c-8f19-17e7b2c5ce82-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:30 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 Nov 05 08:35:30 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Creating offline snapshot ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:30 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" returned: 0 in 0.441s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[82509c19-507e-45a3-b322-e947c314693c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:30 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9 Nov 05 08:35:30 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:30 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:30 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:30 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9" released by "delete_volume" :: held 0.813s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['699afe1d-8140-4aa8-93c6-f81384159ee6', 'a051f495-4365-4611-8425-7093876c8001', 'aeb188a3-2466-4147-8381-7e79e6e0d2f0', 'f024ce37-01f9-499c-b35a-5b891824397b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:30 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.498s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:30 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 1G Nov 05 08:35:30 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-c4e49fe8-d5cb-4f4d-99fd-369f9819532f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:31 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:31 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-c4e49fe8-d5cb-4f4d-99fd-369f9819532f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "cinder-quobyte-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0576fd8f-e14a-4b27-8b80-a27f249b15de]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:31 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f Nov 05 08:35:31 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:31 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e04ba8b8-3f4f-4c49-ae69-e5dc6f4e2092 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-925d276d-1401-41c6-9ce6-3b1b4e1fd4d9-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:31 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 1G" returned: 0 in 0.888s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:31 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" returned: 0 in 0.588s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:31 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 Nov 05 08:35:31 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:31 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f Nov 05 08:35:31 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:32 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" returned: 0 in 0.434s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 is being set with open permissions: ugo+rw Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:32 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" returned: 0 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:32 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 Nov 05 08:35:32 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-quobyte-c4e49fe8-d5cb-4f4d-99fd-369f9819532f" released by "delete_volume" :: held 1.064s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Created reservations ['a2c53151-5f32-4b82-a882-592cc7eab866', 'f6bfe569-c9cf-4337-b49b-2397c828051a', 'b873ce54-d254-4c50-9b84-e06825ae95d0', '1664a65b-294b-46b3-ae90-066d1805b62e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:32 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:32 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:32 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" returned: 0 in 0.318s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-dd6a6033-a658-4edc-830e-6b60e2380479 tempest-VolumesSnapshotListTestJSON-249384471 None] Create snapshot completed successfully Nov 05 08:35:32 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Deleted volume successfully. Nov 05 08:35:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d8da5530-09e0-4a79-bbd6-a0983f44ce15 tempest-CreateVolumesFromSourceVolumeTest-1592209816 None] Lock "cinder-c4e49fe8-d5cb-4f4d-99fd-369f9819532f-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Deleting offline snapshot ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] snapshot_file for this snap is: volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85c691-b423-4add-93cf-f0775f9b1e4b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:35 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 Nov 05 08:35:35 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:35 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c91db-16c4-4265-81ba-a512edbab52e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:35 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:35 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (959fc42f-3670-49a0-a8f1-85dd790aee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:36 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e3fded-d3a1-4112-97b6-820c4c05104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e3fded-d3a1-4112-97b6-820c4c05104a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825546767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cba565-2994-498c-af4a-49b1d229a7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:36Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:36 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 Nov 05 08:35:36 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ccdf6a-1c03-4e46-827e-ef99525047e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ccdf6a-1c03-4e46-827e-ef99525047e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493f50fa-daa7-4ac3-bddf-f8aba35f3085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493f50fa-daa7-4ac3-bddf-f8aba35f3085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95cba565-2994-498c-af4a-49b1d229a7c4', 'volume_name': 'volume-95cba565-2994-498c-af4a-49b1d229a7c4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006c2a0b-efdf-4a0b-a21a-5f9d181f63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006c2a0b-efdf-4a0b-a21a-5f9d181f63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda6dafd-e135-4f4e-8584-e54270700e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:36 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume 95cba565-2994-498c-af4a-49b1d229a7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95cba565-2994-498c-af4a-49b1d229a7c4', 'volume_size': 1} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825546767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95cba565-2994-498c-af4a-49b1d229a7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:36Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume 95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:36 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:36 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 1073741824 Nov 05 08:35:36 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:36 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:36 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83 Nov 05 08:35:36 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:36 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 1073741824" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:36 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 Nov 05 08:35:36 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:36 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" returned: 0 in 0.326s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83" released by "_delete_snapshot" :: held 2.136s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" released by "delete_snapshot" :: held 2.170s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:37 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4" returned: 0 in 0.332s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda6dafd-e135-4f4e-8584-e54270700e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95cba565-2994-498c-af4a-49b1d229a7c4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b0234d-a595-431b-a150-d68ecc9b6f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-95cba565-2994-498c-af4a-49b1d229a7c4 (95cba565-2994-498c-af4a-49b1d229a7c4): created successfully Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b0234d-a595-431b-a150-d68ecc9b6f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (959fc42f-3670-49a0-a8f1-85dd790aee6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Created reservations ['c1b27723-8a5e-4ae9-9e75-de66bc9fc74e', '8713ce75-9a03-4651-883f-8c326ed46d68', '87dde2ee-54a2-4632-8cdd-9ed644402fd4', '4adb001b-93f9-4c9c-abb2-5c8f032dab36'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-54af52e1-63f2-494a-be38-852bbfb8b89e tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Delete snapshot completed successfully. Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ad8744da-26dc-45b8-9d0b-489291fa82cc tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-ba6a2bc1-c4c3-4fa0-9ff2-77c38f951b83-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Flow 'volume_create_manager' (cc3f58e2-a1d5-43d9-9a1a-313f23586dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9a1210-f28a-40e5-855f-1b674e58aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9a1210-f28a-40e5-855f-1b674e58aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697257087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68505662-8fa3-4cca-829f-cd5f955ab851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d05d05b030452c9016dea55f69e6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:38Z,use_quota=True,user_id='4452f855a23f4260a5062e0032b00674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5b0aea-60d1-4d41-998c-07736f33fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5b0aea-60d1-4d41-998c-07736f33fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0354c014-d5d5-468f-9bc6-21c21cf9909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0354c014-d5d5-468f-9bc6-21c21cf9909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68505662-8fa3-4cca-829f-cd5f955ab851', 'volume_name': 'volume-68505662-8fa3-4cca-829f-cd5f955ab851', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d5d27-b193-464e-a2e4-7bb2f09dab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665d5d27-b193-464e-a2e4-7bb2f09dab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c81ca8-acec-4ce8-a2a5-cdc27824fc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Volume 68505662-8fa3-4cca-829f-cd5f955ab851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68505662-8fa3-4cca-829f-cd5f955ab851', 'volume_size': 1} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697257087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68505662-8fa3-4cca-829f-cd5f955ab851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d05d05b030452c9016dea55f69e6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:38Z,use_quota=True,user_id='4452f855a23f4260a5062e0032b00674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Creating volume 68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:37 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 1073741824 Nov 05 08:35:37 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-17c40c99-c288-40da-b01d-4a1d760231b1-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-17c40c99-c288-40da-b01d-4a1d760231b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-17c40c99-c288-40da-b01d-4a1d760231b1" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-17c40c99-c288-40da-b01d-4a1d760231b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Deleting offline snapshot 17c40c99-c288-40da-b01d-4a1d760231b1 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] snapshot_file for this snap is: volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5569e-fa39-487c-9563-7c2a50b6ddd3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:38 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:38 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:38 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 1073741824" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:38 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:35:38 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:38 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55a2b8-6803-42b2-95f8-c8af92d407d3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:38 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.265s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.335s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c81ca8-acec-4ce8-a2a5-cdc27824fc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68505662-8fa3-4cca-829f-cd5f955ab851', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c72e42-41ac-41e7-b9a4-2e0dd4c0a301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating offline snapshot bc256f71-97cd-4cf3-8d10-89f5848ce70c of volume 95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Volume volume-68505662-8fa3-4cca-829f-cd5f955ab851 (68505662-8fa3-4cca-829f-cd5f955ab851): created successfully Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c72e42-41ac-41e7-b9a4-2e0dd4c0a301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Flow 'volume_create_manager' (cc3f58e2-a1d5-43d9-9a1a-313f23586dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3e640-05b3-4bf1-8bd0-7d42d4cc688d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:38 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:38 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6ec2d043-63d3-4d95-b010-14f7926c5ccd tempest-VolumeDependencyTests-1475731787 None] Created volume successfully. Nov 05 08:35:38 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 Nov 05 08:35:38 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:39 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:39 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:39 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:39 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:39 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c 1G Nov 05 08:35:39 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:39 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:39 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1 Nov 05 08:35:39 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:39 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c 1G" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cba565-2994-498c-af4a-49b1d229a7c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:39 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cba565-2994-498c-af4a-49b1d229a7c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c Nov 05 08:35:39 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:39 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.17c40c99-c288-40da-b01d-4a1d760231b1" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-17c40c99-c288-40da-b01d-4a1d760231b1" released by "_delete_snapshot" :: held 1.612s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" released by "delete_snapshot" :: held 1.638s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Created reservations ['174970b1-a7cc-4f72-89a3-8db60345d39a', '733aa4c2-d59e-4755-9f25-a31500c773fc', '0e53cbf0-a892-45fd-b50f-169609d5b127', 'd5f6b0cf-449a-4268-a777-75f328c68062'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:39 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95cba565-2994-498c-af4a-49b1d229a7c4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:39 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c is being set with open permissions: ugo+rw Nov 05 08:35:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c Nov 05 08:35:40 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Delete snapshot completed successfully. Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3c274fe1-268b-4796-b5a3-306acbb1156a tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-17c40c99-c288-40da-b01d-4a1d760231b1-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:40 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info Nov 05 08:35:40 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-b20ed859-c20b-409e-9080-32b10c7ec964-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-b20ed859-c20b-409e-9080-32b10c7ec964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-b20ed859-c20b-409e-9080-32b10c7ec964" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-b20ed859-c20b-409e-9080-32b10c7ec964" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Deleting offline snapshot b20ed859-c20b-409e-9080-32b10c7ec964 of volume bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] snapshot_file for this snap is: volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c4cd4-7ca7-4c97-8a75-d34246110ede]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:40 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info is being set with open permissions: ugo+rw Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:40 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:40 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info Nov 05 08:35:40 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:40 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.info" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:40 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1769ab-4302-4462-a17f-0e3e83f41978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Creating offline snapshot e8709cbc-13ce-4107-98bb-fa6637e4826b of volume 68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf2262-64ff-4cc6-a8dd-3e521f223cab]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b62918d1-0a4f-48c6-806e-566d23811a5b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Create snapshot completed successfully Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[93818236-fdfd-4c05-a315-c98064cfabdc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:40 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 Nov 05 08:35:40 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:35:41 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:41 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:41 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:41 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b 1G Nov 05 08:35:41 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:41 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964 Nov 05 08:35:41 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b 1G" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68505662-8fa3-4cca-829f-cd5f955ab851 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:41 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68505662-8fa3-4cca-829f-cd5f955ab851 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:41 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:41 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978.b20ed859-c20b-409e-9080-32b10c7ec964" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-b20ed859-c20b-409e-9080-32b10c7ec964" released by "_delete_snapshot" :: held 1.506s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" released by "delete_snapshot" :: held 1.537s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Created reservations ['a39c24e0-cd83-43fa-8c5c-aebb0d732cf2', 'd8f1809d-85b6-47b7-bcc6-b303bb519747', '8d0d07a6-2962-445d-9361-05325e13e38e', '0c297c22-972c-48f8-be7d-c717d3582937'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:42 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68505662-8fa3-4cca-829f-cd5f955ab851 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b is being set with open permissions: ugo+rw Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:42 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:42 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Delete snapshot completed successfully. Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (b88b3014-12f2-4332-9011-97073670ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39227e1e-cc2d-46dd-8541-c2a2fed396a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-36aac6c9-7533-4e30-94d0-6d72fe56aa1d tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-b20ed859-c20b-409e-9080-32b10c7ec964-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39227e1e-cc2d-46dd-8541-c2a2fed396a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794625846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18febd5-b3a1-4cf4-87f4-c04fdf3432fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:42Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e554ed6-a911-4086-bda2-c7a13d3870eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e554ed6-a911-4086-bda2-c7a13d3870eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069bc50-db97-4590-ac05-577ad4fe1b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069bc50-db97-4590-ac05-577ad4fe1b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18febd5-b3a1-4cf4-87f4-c04fdf3432fe', 'volume_name': 'volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4629c99-48a2-40cb-8cce-8bbd43abdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4629c99-48a2-40cb-8cce-8bbd43abdac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94946ba0-290e-49f1-bd51-b4e23e353c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume d18febd5-b3a1-4cf4-87f4-c04fdf3432fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe', 'volume_size': 1} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:42 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:42 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info Nov 05 08:35:42 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (ba213a64-f959-4e1d-bf16-0244ee0e5f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f44c50-3916-49b6-bb8b-e13cea393b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f44c50-3916-49b6-bb8b-e13cea393b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757509285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f4e085-27ab-41bb-b468-dd664a83b52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:42Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099a5bd-5854-45f4-9669-cdc5c7012346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099a5bd-5854-45f4-9669-cdc5c7012346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ba865-636b-4696-97ed-d08d0c0cdd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ba865-636b-4696-97ed-d08d0c0cdd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f4e085-27ab-41bb-b468-dd664a83b52c', 'volume_name': 'volume-d0f4e085-27ab-41bb-b468-dd664a83b52c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0427c0e2-1f83-4466-84b7-229ae61a370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0427c0e2-1f83-4466-84b7-229ae61a370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e5bbf-bbb1-4404-bcd7-7fb156108f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume d0f4e085-27ab-41bb-b468-dd664a83b52c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f4e085-27ab-41bb-b468-dd664a83b52c', 'volume_size': 1} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-bb1769ab-4302-4462-a17f-0e3e83f41978-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-bb1769ab-4302-4462-a17f-0e3e83f41978-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:42 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[287edf80-c3db-4500-8c46-da5b1918035f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info is being set with open permissions: ugo+rw Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:42 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info Nov 05 08:35:42 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:42 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 Nov 05 08:35:42 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (c65db4f7-a513-4a1e-847a-fa52d5720f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eeb4bb-fbcf-4c88-8888-5f86fbda3a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eeb4bb-fbcf-4c88-8888-5f86fbda3a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146401563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2f584-3d37-44ff-96f4-8765870aadbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:43Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c564a8bf-87df-4097-b773-7fc710d62ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c564a8bf-87df-4097-b773-7fc710d62ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e0abdf-d7a9-4b07-8684-439b03b3fb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e0abdf-d7a9-4b07-8684-439b03b3fb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c2f584-3d37-44ff-96f4-8765870aadbd', 'volume_name': 'volume-47c2f584-3d37-44ff-96f4-8765870aadbd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3830f-94d1-4850-af13-5460d35ba6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b3830f-94d1-4850-af13-5460d35ba6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d82b1a-2b77-4b64-a4f6-b4cbaa94f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume 47c2f584-3d37-44ff-96f4-8765870aadbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c2f584-3d37-44ff-96f4-8765870aadbd', 'volume_size': 1} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:43 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.info" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794625846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18febd5-b3a1-4cf4-87f4-c04fdf3432fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:42Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume d18febd5-b3a1-4cf4-87f4-c04fdf3432fe {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:43 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe 1073741824 Nov 05 08:35:43 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5572780d-48c0-4742-baf9-799b9df732b7 tempest-VolumeDependencyTests-1475731787 None] Create snapshot completed successfully Nov 05 08:35:43 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978" returned: 0 in 0.563s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:43 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978 Nov 05 08:35:43 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (e8053d8a-d161-40ba-bef5-bf87f6012f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b58c403-c318-4a92-9a08-d332861f55c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b58c403-c318-4a92-9a08-d332861f55c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965095304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf18a5e4-cb7c-4882-9333-f95f501eb355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:43Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f95ae8-a43f-4d4f-b64e-a07695c2d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f95ae8-a43f-4d4f-b64e-a07695c2d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54149e0d-e86a-4a32-8658-39e555b0cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54149e0d-e86a-4a32-8658-39e555b0cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf18a5e4-cb7c-4882-9333-f95f501eb355', 'volume_name': 'volume-bf18a5e4-cb7c-4882-9333-f95f501eb355', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39cbbc0-9437-4e2b-ab2a-6861bcf2d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39cbbc0-9437-4e2b-ab2a-6861bcf2d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84280206-56b0-4622-b0c3-c6ec1bb17677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume bf18a5e4-cb7c-4882-9333-f95f501eb355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf18a5e4-cb7c-4882-9333-f95f501eb355', 'volume_size': 1} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:43 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe 1073741824" returned: 0 in 0.656s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:43 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bb1769ab-4302-4462-a17f-0e3e83f41978" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:43 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe Nov 05 08:35:43 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-quobyte-bb1769ab-4302-4462-a17f-0e3e83f41978" released by "delete_volume" :: held 1.162s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (209b60ce-742f-4efb-9cb5-0e054846a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56c0716-bffe-4a51-a8d7-0e86d931e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56c0716-bffe-4a51-a8d7-0e86d931e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203221348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f1492-1a9a-47c4-bc82-a56a92aeb8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:44Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18974cfa-4ef9-4d6e-82f2-46ded3d3c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18974cfa-4ef9-4d6e-82f2-46ded3d3c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcaa68d-7830-48cb-b975-0bdf4a582c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcaa68d-7830-48cb-b975-0bdf4a582c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13f1492-1a9a-47c4-bc82-a56a92aeb8b1', 'volume_name': 'volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774d2e05-9f45-4a79-a1d1-91bda44798d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774d2e05-9f45-4a79-a1d1-91bda44798d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4f39d-edec-40cb-bff9-bd339724e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume f13f1492-1a9a-47c4-bc82-a56a92aeb8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1', 'volume_size': 1} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Created reservations ['aa156759-6e28-49d0-988d-3b93b9e48edc', 'ded116f4-3d84-43ba-9326-1f644ca6eb5c', '36fa590f-5b8b-4550-ac1e-ce0b3c59b3ab', 'a1fcca4f-09d0-4169-b180-0705afb4ad70'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:44 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757509285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f4e085-27ab-41bb-b468-dd664a83b52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:42Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume d0f4e085-27ab-41bb-b468-dd664a83b52c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:35:44 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c 1073741824 Nov 05 08:35:44 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94946ba0-290e-49f1-bd51-b4e23e353c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5d751-2c29-4885-9e34-b6a548b03f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Flow 'volume_create_manager' (c5d06811-c06a-4241-9f15-9d39ab628347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a3e27-0240-44b8-9a3f-4ba88579c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe (d18febd5-b3a1-4cf4-87f4-c04fdf3432fe): created successfully Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5d751-2c29-4885-9e34-b6a548b03f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (b88b3014-12f2-4332-9011-97073670ac80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a3e27-0240-44b8-9a3f-4ba88579c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868224182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d8ebd6-1c21-4e1f-a768-23b057b3e6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d05d05b030452c9016dea55f69e6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8709cbc-13ce-4107-98bb-fa6637e4826b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:44Z,use_quota=True,user_id='4452f855a23f4260a5062e0032b00674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4e58b8-f759-4afd-a9e4-5f9ec2ac270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4e58b8-f759-4afd-a9e4-5f9ec2ac270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e538671b-13c8-43a2-8df4-880e3c3504c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e538671b-13c8-43a2-8df4-880e3c3504c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '36d8ebd6-1c21-4e1f-a768-23b057b3e6d5', 'volume_name': 'volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5', 'volume_size': 1, 'snapshot_id': 'e8709cbc-13ce-4107-98bb-fa6637e4826b'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e832148e-a779-465e-ab3c-dde8600b90f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e832148e-a779-465e-ab3c-dde8600b90f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5154184-6859-49be-9779-ceec3b16811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Volume 36d8ebd6-1c21-4e1f-a768-23b057b3e6d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5', 'volume_size': 1, 'snapshot_id': 'e8709cbc-13ce-4107-98bb-fa6637e4826b'} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4a70d1c5-7a15-4811-8f80-89e172b3602a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:44 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:44 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:44 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c 1073741824" returned: 0 in 0.440s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:44 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Deleted volume successfully. Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-011fafdb-a23a-48a2-9f6b-d8cfd46121c9 tempest-VolumesSnapshotListTestJSON-249384471 None] Lock "cinder-bb1769ab-4302-4462-a17f-0e3e83f41978-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:44 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c Nov 05 08:35:44 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:44 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146401563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c2f584-3d37-44ff-96f4-8765870aadbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:43Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume 47c2f584-3d37-44ff-96f4-8765870aadbd {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0e5bbf-bbb1-4404-bcd7-7fb156108f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f4e085-27ab-41bb-b468-dd664a83b52c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd 1073741824 Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2971cb41-211a-4a11-9f23-b6616cd1846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:44 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-d0f4e085-27ab-41bb-b468-dd664a83b52c (d0f4e085-27ab-41bb-b468-dd664a83b52c): created successfully Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2971cb41-211a-4a11-9f23-b6616cd1846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (ba213a64-f959-4e1d-bf16-0244ee0e5f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4efdbd84-61b2-4e4b-bd74-58657f7ff2e0 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:45 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd 1073741824" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:45 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd Nov 05 08:35:45 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:45 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.095s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965095304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf18a5e4-cb7c-4882-9333-f95f501eb355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:43Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume bf18a5e4-cb7c-4882-9333-f95f501eb355 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d82b1a-2b77-4b64-a4f6-b4cbaa94f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c2f584-3d37-44ff-96f4-8765870aadbd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:45 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 1073741824 Nov 05 08:35:45 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd088e7e-10d4-4521-b724-a86489effcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-47c2f584-3d37-44ff-96f4-8765870aadbd (47c2f584-3d37-44ff-96f4-8765870aadbd): created successfully Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd088e7e-10d4-4521-b724-a86489effcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (c65db4f7-a513-4a1e-847a-fa52d5720f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3b50e04e-41f2-4789-89ab-3a622dd2e3b6 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:46 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 1073741824" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:46 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 Nov 05 08:35:46 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:46 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.404s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203221348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f1492-1a9a-47c4-bc82-a56a92aeb8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8cd0aae7b644d0906bdfe63911267f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:35:44Z,use_quota=True,user_id='210903513db44309956129a7daef9329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Creating volume f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:46 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84280206-56b0-4622-b0c3-c6ec1bb17677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf18a5e4-cb7c-4882-9333-f95f501eb355', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84bc5b2-7aa5-427b-8fbb-e327d89d4000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:46 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 1073741824 Nov 05 08:35:46 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 (bf18a5e4-cb7c-4882-9333-f95f501eb355): created successfully Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84bc5b2-7aa5-427b-8fbb-e327d89d4000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (e8053d8a-d161-40ba-bef5-bf87f6012f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0cf08060-80b7-45ae-8765-de4fd7c497de tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:46 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 1073741824" returned: 0 in 0.453s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:46 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 Nov 05 08:35:46 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:47 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.944s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a4f39d-edec-40cb-bff9-bd339724e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d39538-368e-4758-82fb-49c916d337c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Creating volume 36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 from snapshot e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Volume volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 (f13f1492-1a9a-47c4-bc82-a56a92aeb8b1): created successfully Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d39538-368e-4758-82fb-49c916d337c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Flow 'volume_create_manager' (209b60ce-742f-4efb-9cb5-0e054846a407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] snapshot: e8709cbc-13ce-4107-98bb-fa6637e4826b, volume: 36d8ebd6-1c21-4e1f-a768-23b057b3e6d5, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:35:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7032f28c-7e9b-435b-88e5-4fad09a53fa8 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created volume successfully. Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a4726-b372-4737-9657-f7f78bb6fb30]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:47 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:47 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:47 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68505662-8fa3-4cca-829f-cd5f955ab851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a64ed66-a7df-49d6-acd1-4b0660a4db1f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:47 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:35:47 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:48 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.379s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:48 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 Nov 05 08:35:48 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6053f487-23e7-407c-97f2-0e19a7467211]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:48 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 Nov 05 08:35:48 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:48 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:49 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1 Nov 05 08:35:49 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:49 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" returned: 0 in 0.526s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1" released by "delete_volume" :: held 1.129s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['ef06da3e-2bf5-42da-8b8f-a78c32357500', 'e14d9801-e45f-4e69-9c39-3c56e2007b9b', 'edb4fe78-428a-4a96-9c32-b54992604d07', '1b538721-7639-4ace-a12a-2a3f7dd59e94'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:49 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:49 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:50 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.474s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-39e414f4-1397-4f33-a9c7-1712cb45c03c tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-f13f1492-1a9a-47c4-bc82-a56a92aeb8b1-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-bf18a5e4-cb7c-4882-9333-f95f501eb355-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-bf18a5e4-cb7c-4882-9333-f95f501eb355-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-bf18a5e4-cb7c-4882-9333-f95f501eb355" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-bf18a5e4-cb7c-4882-9333-f95f501eb355" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e373ec6-a5d9-4166-8f97-a5c5f6a032ab]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:51 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 Nov 05 08:35:51 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:51 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355" returned: 0 in 0.743s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:51 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355 Nov 05 08:35:51 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:52 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-bf18a5e4-cb7c-4882-9333-f95f501eb355" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-bf18a5e4-cb7c-4882-9333-f95f501eb355" released by "delete_volume" :: held 1.346s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['2f7ab85f-556c-4c42-8ea6-84d95cc50162', '4b3407c6-74e1-4980-a740-dbbc11bf819a', '10913d10-cbae-4688-bc1d-76f78143afd7', 'f34aba68-af61-41d1-a061-48328d70783e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:52 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:52 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:53 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.528s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2592b611-32e0-446b-a283-f0677357abfb tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-bf18a5e4-cb7c-4882-9333-f95f501eb355-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-47c2f584-3d37-44ff-96f4-8765870aadbd-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-47c2f584-3d37-44ff-96f4-8765870aadbd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-47c2f584-3d37-44ff-96f4-8765870aadbd" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-47c2f584-3d37-44ff-96f4-8765870aadbd" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799ad94-b0cb-4383-a436-0eee35fd4dc7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:53 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd Nov 05 08:35:53 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:54 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd" returned: 0 in 0.646s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:54 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd Nov 05 08:35:54 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:54 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-47c2f584-3d37-44ff-96f4-8765870aadbd" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-47c2f584-3d37-44ff-96f4-8765870aadbd" released by "delete_volume" :: held 1.254s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['19fbe8c1-ed52-4dc6-8827-9098ab97dce3', '9f2e5e7d-491a-47bb-98e1-f77e5606876a', '61cb7524-60e2-42db-afb7-83907204775a', '44617629-4e80-4df4-9770-4477690dff5e'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:55 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:55 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:55 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.522s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8303cbb5-093e-4d37-bf01-3defdfe1e156 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-47c2f584-3d37-44ff-96f4-8765870aadbd-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-d0f4e085-27ab-41bb-b468-dd664a83b52c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-d0f4e085-27ab-41bb-b468-dd664a83b52c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-d0f4e085-27ab-41bb-b468-dd664a83b52c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-d0f4e085-27ab-41bb-b468-dd664a83b52c" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d77696-b0aa-416d-bd33-b512186f728f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:56 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c Nov 05 08:35:56 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:56 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" returned: 0 in 8.332s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:35:56 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Converted 1024.00 MB image at 122.86 MB/s Nov 05 08:35:56 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 is being set with open permissions: ugo+rw Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:56 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 Nov 05 08:35:56 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:56 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c" returned: 0 in 0.629s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:56 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c Nov 05 08:35:56 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:56 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" released by "_copy_volume_from_snapshot" :: held 9.500s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" released by "_create_volume_from_snapshot" :: held 9.596s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.633s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:56 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5154184-6859-49be-9779-ceec3b16811e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5', 'volume_size': 1, 'snapshot_id': 'e8709cbc-13ce-4107-98bb-fa6637e4826b'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ed925-c3df-46cb-97f3-2b5328458363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d0f4e085-27ab-41bb-b468-dd664a83b52c" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-d0f4e085-27ab-41bb-b468-dd664a83b52c" released by "delete_volume" :: held 1.072s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:56 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Volume volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 (36d8ebd6-1c21-4e1f-a768-23b057b3e6d5): created successfully Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ed925-c3df-46cb-97f3-2b5328458363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:35:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Flow 'volume_create_manager' (c5d06811-c06a-4241-9f15-9d39ab628347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:35:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8766bad4-90df-4dfa-b702-40b0826176f8 tempest-VolumeDependencyTests-1475731787 None] Created volume successfully. Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['89ebd16e-a47c-44ed-b009-a88f475378c6', '73fb3288-0270-4755-9176-0459e3ea5192', '1363c8e0-0af8-448f-bb67-76fda58fee50', '67a5893a-5e68-4923-8652-d95ec69d74a8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:57 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:57 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-e8709cbc-13ce-4107-98bb-fa6637e4826b-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-e8709cbc-13ce-4107-98bb-fa6637e4826b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Deleting offline snapshot e8709cbc-13ce-4107-98bb-fa6637e4826b of volume 68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:57 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] snapshot_file for this snap is: volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.391s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[857489b2-3186-4715-8bed-003cb3c842d6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d4000b46-f3b3-4453-8c4e-0f13d39a9c4b tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-d0f4e085-27ab-41bb-b468-dd664a83b52c-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:57 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:57 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:57 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68505662-8fa3-4cca-829f-cd5f955ab851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc75177-edf0-452e-ab1d-394d019aaa7a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:58 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:35:58 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" acquired by "delete_volume" :: waited 0.046s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc68056-0c94-45ce-aa5b-22adda139b2c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe Nov 05 08:35:58 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:58 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:58 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe Nov 05 08:35:58 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.764s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:58 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:58 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:59 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe" released by "delete_volume" :: held 0.838s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['d0a64452-6aab-4c28-8d6f-4bac393182c0', '8e564c3d-9ee9-438a-bbf8-84dc4e89ee80', '52950084-cfca-4d26-8479-8b8c81022715', '45796076-fb37-444e-93f6-53daf1e598b5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:59 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:59 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b Nov 05 08:35:59 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:59 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:35:59 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-bc256f71-97cd-4cf3-8d10-89f5848ce70c-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-bc256f71-97cd-4cf3-8d10-89f5848ce70c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-bc256f71-97cd-4cf3-8d10-89f5848ce70c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-bc256f71-97cd-4cf3-8d10-89f5848ce70c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleting offline snapshot bc256f71-97cd-4cf3-8d10-89f5848ce70c of volume 95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] snapshot_file for this snap is: volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ee961-ac0b-44ed-aa62-4775fb4857fa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:35:59 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851.e8709cbc-13ce-4107-98bb-fa6637e4826b" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-e8709cbc-13ce-4107-98bb-fa6637e4826b" released by "_delete_snapshot" :: held 2.140s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:59 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" released by "delete_snapshot" :: held 2.172s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:35:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:35:59 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c Nov 05 08:35:59 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003d6fef-3e5c-4a13-8b18-18a911019d9d tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-d18febd5-b3a1-4cf4-87f4-c04fdf3432fe-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Created reservations ['5a0fd6e5-d1fb-4bc6-981a-71a05502b4d2', '650efc32-f4de-449f-bda8-4ea9aae762d2', '42d376a5-f7fb-4e32-a309-145d1155fb57', 'c171a336-8ed3-4a70-b93d-342c67e6a45a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:35:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Delete snapshot completed successfully. Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-105281fb-bb40-4392-8f56-3ce707cc78b9 tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-e8709cbc-13ce-4107-98bb-fa6637e4826b-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:35:59 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95cba565-2994-498c-af4a-49b1d229a7c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c21e5-3719-46c4-8f8a-4dbd109c1676]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:35:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:00 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 Nov 05 08:36:00 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:00 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:00 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c Nov 05 08:36:00 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-68505662-8fa3-4cca-829f-cd5f955ab851-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-68505662-8fa3-4cca-829f-cd5f955ab851-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:00 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c" returned: 0 in 0.462s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f184ef0-2f07-4071-9c5d-73de656af213]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:00 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c Nov 05 08:36:00 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:01 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:36:01 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:01 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4.bc256f71-97cd-4cf3-8d10-89f5848ce70c" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-bc256f71-97cd-4cf3-8d10-89f5848ce70c" released by "_delete_snapshot" :: held 1.799s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" released by "delete_snapshot" :: held 1.828s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['ffdc9e43-843e-47fa-9f4a-1c50d2915fbf', 'e9afcbd5-3c3b-4958-bf95-6bb396581666', 'f8085c97-e150-464e-9ed8-885238376c44', '170391e2-4043-43be-95c1-97da5dc3105a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Delete snapshot completed successfully. Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9b75ba33-ed3f-4299-872d-dc6bec280e9a tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-bc256f71-97cd-4cf3-8d10-89f5848ce70c-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:01 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:01 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851 Nov 05 08:36:01 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-95cba565-2994-498c-af4a-49b1d229a7c4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-95cba565-2994-498c-af4a-49b1d229a7c4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c946106-0e45-4311-9dc7-dd52253d8ea4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:01 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-68505662-8fa3-4cca-829f-cd5f955ab851" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-68505662-8fa3-4cca-829f-cd5f955ab851" released by "delete_volume" :: held 0.966s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Created reservations ['5c85e8c1-af22-48bf-84c7-1a0462032731', '350f25e1-1c47-4514-aaf0-e984bfd7ac67', '5261c02b-5b08-454c-8ad0-757424999d7f', '241441cb-e407-42a0-b481-ca6267120c7f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:01 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 Nov 05 08:36:01 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:01 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:01 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:02 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:02 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4 Nov 05 08:36:02 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:02 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Deleted volume successfully. Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7b96d317-3de5-49ea-9d9a-b514ca32eb7b tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-68505662-8fa3-4cca-829f-cd5f955ab851-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:02 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-95cba565-2994-498c-af4a-49b1d229a7c4" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-quobyte-95cba565-2994-498c-af4a-49b1d229a7c4" released by "delete_volume" :: held 0.774s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Created reservations ['814abe6d-d3ad-47be-8926-192e9155de5e', '3d072370-2fa2-4eb8-8f51-1ce52e09884b', '5aa87f43-fd6d-4cd7-808b-128b6be6ea62', '12306743-2898-4078-9657-c3233804cfb4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:02 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:02 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:02 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Deleted volume successfully. Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa5fcb3a-9ccf-4c11-96b2-5262a97b6af3 tempest-CreateVolumesFromSnapshotTest-1481307147 None] Lock "cinder-95cba565-2994-498c-af4a-49b1d229a7c4-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca5ec2-8837-4a70-b957-d0e2bcae2654]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:03 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 Nov 05 08:36:03 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:03 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:03 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5 Nov 05 08:36:03 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:03 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" returned: 0 in 0.298s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-quobyte-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5" released by "delete_volume" :: held 0.765s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Created reservations ['dee6bbd9-ed34-449f-b9bd-a67cdb89396a', '1f960147-0c2c-444a-9e28-b922574800ae', '5a65d4dc-0cec-4947-a00e-9ac7fdbfb44f', 'a6045582-f0e6-433e-a381-fd9708f221ae'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:03 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:03 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:04 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:04 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Deleted volume successfully. Nov 05 08:36:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-6c483d53-c01b-4164-beb2-fbc778b081cc tempest-VolumeDependencyTests-1475731787 None] Lock "cinder-36d8ebd6-1c21-4e1f-a768-23b057b3e6d5-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=174,cinder:SELECT=116,cinder:INSERT=48,cinder:DELETE=9 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:36:14 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=154,cinder:INSERT=45,cinder:UPDATE=187,cinder:DELETE=20 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (d9c01274-3e6e-447d-b93c-d73a40291566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd4db54-e4e2-43a4-bd7d-5808e36eaf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd4db54-e4e2-43a4-bd7d-5808e36eaf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1630887635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28e4734-9b07-48d4-afa2-4bccc7f33d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:16Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115c40aa-1a0e-497f-99f4-e8789bbf10af),volume_type_id=115c40aa-1a0e-497f-99f4-e8789bbf10af)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c018fb-8b13-4d17-98a3-be9c317f2d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c018fb-8b13-4d17-98a3-be9c317f2d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9309a9-ca5b-4c6b-b8ad-44305c122525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9309a9-ca5b-4c6b-b8ad-44305c122525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28e4734-9b07-48d4-afa2-4bccc7f33d41', 'volume_name': 'volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8387cd90-1fa8-4385-938c-6d858b78b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8387cd90-1fa8-4385-938c-6d858b78b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a25dd-aaa5-4b70-bbaa-2115d6a1132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume f28e4734-9b07-48d4-afa2-4bccc7f33d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41', 'volume_size': 1} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1630887635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28e4734-9b07-48d4-afa2-4bccc7f33d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:16Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115c40aa-1a0e-497f-99f4-e8789bbf10af),volume_type_id=115c40aa-1a0e-497f-99f4-e8789bbf10af)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Creating volume f28e4734-9b07-48d4-afa2-4bccc7f33d41 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:16 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:16 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 1073741824 Nov 05 08:36:16 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (036e2d3c-6926-478d-8ba1-b755ad752037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d83ea5-500f-41f9-b143-7f72f8f68393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d83ea5-500f-41f9-b143-7f72f8f68393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1924569586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1612771-cb44-441b-9273-19f1c8f3c0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:17Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af1c3f5-60bf-4a7d-b3c6-1d38cd244166),volume_type_id=2af1c3f5-60bf-4a7d-b3c6-1d38cd244166)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4063361c-3697-4b18-91f3-b0f047daf371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4063361c-3697-4b18-91f3-b0f047daf371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184fd2e8-eebd-41aa-9ba7-11b6c04646ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184fd2e8-eebd-41aa-9ba7-11b6c04646ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1612771-cb44-441b-9273-19f1c8f3c0e9', 'volume_name': 'volume-b1612771-cb44-441b-9273-19f1c8f3c0e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794ebc50-2280-448d-b55e-65647894c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794ebc50-2280-448d-b55e-65647894c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801a5b82-0173-4072-add0-daf30c6ff08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume b1612771-cb44-441b-9273-19f1c8f3c0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1612771-cb44-441b-9273-19f1c8f3c0e9', 'volume_size': 1} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:17 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 1073741824" returned: 0 in 0.613s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:17 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 Nov 05 08:36:17 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:17 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1924569586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1612771-cb44-441b-9273-19f1c8f3c0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:17Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af1c3f5-60bf-4a7d-b3c6-1d38cd244166),volume_type_id=2af1c3f5-60bf-4a7d-b3c6-1d38cd244166)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Creating volume b1612771-cb44-441b-9273-19f1c8f3c0e9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:17 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 1073741824 Nov 05 08:36:17 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a25dd-aaa5-4b70-bbaa-2115d6a1132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a4f1d-5202-42d4-9609-a7b9a86ced40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (0ae1334d-3db1-49d9-a486-7f33b6c3e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcc9a20-4e63-4397-a2c9-e62fb742fc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 (f28e4734-9b07-48d4-afa2-4bccc7f33d41): created successfully Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a4f1d-5202-42d4-9609-a7b9a86ced40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (d9c01274-3e6e-447d-b93c-d73a40291566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcc9a20-4e63-4397-a2c9-e62fb742fc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1834906169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c8fed5-672f-4461-ac65-fbf9d531c2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:18Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da4aa3de-2651-47df-b099-3a4ec053f63a),volume_type_id=da4aa3de-2651-47df-b099-3a4ec053f63a)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc9180d-969d-43bb-9be8-4d8a4d0fe83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc9180d-969d-43bb-9be8-4d8a4d0fe83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a35b58-8a9e-402a-bd33-01c80b55fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:17 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:36:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-11e3b682-8c35-425a-bfe7-e844e0dc07f9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Created volume successfully. Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (b10b18e9-ae70-44bd-86c8-78fd2a18aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a008717b-8e8d-4a08-92e3-d0bf923c8c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a008717b-8e8d-4a08-92e3-d0bf923c8c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568892525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7210b4cd-eb67-4edc-af43-b68071a63865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:18Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ffc36-46d5-4005-93b1-c1a6e762fc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ffc36-46d5-4005-93b1-c1a6e762fc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1650b6-b155-4753-8a18-d0e72b260899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1650b6-b155-4753-8a18-d0e72b260899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7210b4cd-eb67-4edc-af43-b68071a63865', 'volume_name': 'volume-7210b4cd-eb67-4edc-af43-b68071a63865', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d647edf0-fc6d-4c32-ba97-4ca23400e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d647edf0-fc6d-4c32-ba97-4ca23400e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68ac8d5-601a-4772-94fa-62d3af949b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Volume 7210b4cd-eb67-4edc-af43-b68071a63865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7210b4cd-eb67-4edc-af43-b68071a63865', 'volume_size': 1} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:18 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 1073741824" returned: 0 in 0.574s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a35b58-8a9e-402a-bd33-01c80b55fb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54c8fed5-672f-4461-ac65-fbf9d531c2ac', 'volume_name': 'volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac', 'volume_size': 1, 'image_id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567060437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96391469024d4dc0b3449b9ed50b07f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'created_at': datetime.datetime(2026, 11, 5, 7, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12945d06-1f69-405e-9cbe-b49645142d8a/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37856c4b-91b8-4a05-8694-2cf2e1813037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37856c4b-91b8-4a05-8694-2cf2e1813037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecd3607-f01a-4dbe-bdd9-bac6080021f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac', 'volume_size': 1, 'image_id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567060437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96391469024d4dc0b3449b9ed50b07f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'created_at': datetime.datetime(2026, 11, 5, 7, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12945d06-1f69-405e-9cbe-b49645142d8a/file', 'properties': {}}, 'image_service': } Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Trying to clone 54c8fed5-672f-4461-ac65-fbf9d531c2ac from image 12945d06-1f69-405e-9cbe-b49645142d8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:18 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:18 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:18 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 Nov 05 08:36:18 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:18 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:36:18 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568892525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7210b4cd-eb67-4edc-af43-b68071a63865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:18Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Creating volume 7210b4cd-eb67-4edc-af43-b68071a63865 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:18 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:18 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 1073741824 Nov 05 08:36:18 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801a5b82-0173-4072-add0-daf30c6ff08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1612771-cb44-441b-9273-19f1c8f3c0e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30427f94-1bc1-4cf2-be01-a5717f4893bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 (b1612771-cb44-441b-9273-19f1c8f3c0e9): created successfully Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30427f94-1bc1-4cf2-be01-a5717f4893bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (036e2d3c-6926-478d-8ba1-b755ad752037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-12c17509-9c01-461b-aa18-99797d229fcd tempest-TestInstancesWithCinderVolumes-1278075106 None] Created volume successfully. Nov 05 08:36:19 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 1073741824" returned: 0 in 0.508s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:19 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 Nov 05 08:36:19 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:19 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68ac8d5-601a-4772-94fa-62d3af949b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7210b4cd-eb67-4edc-af43-b68071a63865', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bddc7b-6968-440a-97cb-194ae4ce4d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:19 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Volume volume-7210b4cd-eb67-4edc-af43-b68071a63865 (7210b4cd-eb67-4edc-af43-b68071a63865): created successfully Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bddc7b-6968-440a-97cb-194ae4ce4d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:19 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (b10b18e9-ae70-44bd-86c8-78fd2a18aad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ef6e09fc-803e-499f-86fd-9a0b4e49b4ee tempest-ProjectReaderTests-1214882925 None] Created volume successfully. Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-7210b4cd-eb67-4edc-af43-b68071a63865-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-7210b4cd-eb67-4edc-af43-b68071a63865-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-quobyte-7210b4cd-eb67-4edc-af43-b68071a63865" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-7210b4cd-eb67-4edc-af43-b68071a63865" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5b2a5-d686-4111-bca3-b236b699ca3f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:20 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 Nov 05 08:36:20 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:20 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:20 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865 Nov 05 08:36:20 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:21 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-7210b4cd-eb67-4edc-af43-b68071a63865" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-7210b4cd-eb67-4edc-af43-b68071a63865" released by "delete_volume" :: held 0.693s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Created reservations ['0b47dc68-dd54-4bd2-8921-191d8831c2b8', 'af93e298-c1d7-4c4e-a2b5-fbb0b360a871', '104c2e73-dc95-4a9c-b436-8d5fe409a0aa', '6139c043-959c-47ef-a5d2-60d1cdd1b4f8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:21 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:21 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:21 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Deleted volume successfully. Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0c6f1249-b038-4b86-819f-4c8cccd53844 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-7210b4cd-eb67-4edc-af43-b68071a63865-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD, size 20.69 MB, duration 3.58 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:36:21 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Image download 20.69 MB at 5.78 MB/s Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[428bc514-ae65-43d6-9fba-85e4374dc0c1]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (ac179b31-bb52-4dc7-a368-f571fcfad3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f23073a-5260-44f1-b44d-1bbc99e81e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f23073a-5260-44f1-b44d-1bbc99e81e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346061393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631c642-9e32-4151-84ea-604a2edc790b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:22Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6e2a2a-3da0-4e8b-851e-5cd5d505924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6e2a2a-3da0-4e8b-851e-5cd5d505924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:22 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD Nov 05 08:36:22 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3068b84e-747b-4de9-83bb-f3f93afb61d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3068b84e-747b-4de9-83bb-f3f93afb61d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2631c642-9e32-4151-84ea-604a2edc790b', 'volume_name': 'volume-2631c642-9e32-4151-84ea-604a2edc790b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c935b1a-0044-4cfa-809c-ade4b69543d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c935b1a-0044-4cfa-809c-ade4b69543d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681cc590-f51d-46d2-a7b4-7f0c06cea0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Volume 2631c642-9e32-4151-84ea-604a2edc790b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2631c642-9e32-4151-84ea-604a2edc790b', 'volume_size': 1} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346061393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2631c642-9e32-4151-84ea-604a2edc790b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:22Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Creating volume 2631c642-9e32-4151-84ea-604a2edc790b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:22 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b 1073741824 Nov 05 08:36:22 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:22 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Temporary image 12945d06-1f69-405e-9cbe-b49645142d8a is fetched for user e5f7cc1db69b41b390c844679085f20f. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ff0fe-108f-4fb3-ac54-19313abd0364]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:22 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD Nov 05 08:36:22 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:22 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b 1073741824" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:22 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b Nov 05 08:36:22 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:22 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:22 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1834906169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c8fed5-672f-4461-ac65-fbf9d531c2ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96391469024d4dc0b3449b9ed50b07f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:18Z,use_quota=True,user_id='e5f7cc1db69b41b390c844679085f20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da4aa3de-2651-47df-b099-3a4ec053f63a),volume_type_id=da4aa3de-2651-47df-b099-3a4ec053f63a)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Creating volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681cc590-f51d-46d2-a7b4-7f0c06cea0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2631c642-9e32-4151-84ea-604a2edc790b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeaa00a-360d-4424-9801-bd3db7b56396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:22 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1073741824 Nov 05 08:36:22 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Volume volume-2631c642-9e32-4151-84ea-604a2edc790b (2631c642-9e32-4151-84ea-604a2edc790b): created successfully Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeaa00a-360d-4424-9801-bd3db7b56396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (ac179b31-bb52-4dc7-a368-f571fcfad3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-948a65ff-1e8b-4b33-904e-7324ea5e9eae tempest-ProjectReaderTests-1214882925 None] Created volume successfully. Nov 05 08:36:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-2631c642-9e32-4151-84ea-604a2edc790b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-2631c642-9e32-4151-84ea-604a2edc790b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-quobyte-2631c642-9e32-4151-84ea-604a2edc790b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-2631c642-9e32-4151-84ea-604a2edc790b" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e381029a-3210-4ecb-adfa-ce21e7c5ab84]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b Nov 05 08:36:23 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1073741824" returned: 0 in 0.484s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac Nov 05 08:36:23 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b Nov 05 08:36:23 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Attempting download of 12945d06-1f69-405e-9cbe-b49645142d8a ((None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}])) to volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f407d06-ddac-4939-b8d7-ba8774787654]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2631c642-9e32-4151-84ea-604a2edc790b" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp Nov 05 08:36:23 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-2631c642-9e32-4151-84ea-604a2edc790b" released by "delete_volume" :: held 0.658s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Created reservations ['d467129f-ff12-4d21-9ac2-b5e9775d6f3c', '63f4ed8f-3dff-4a37-a2d0-c28c9828b3c1', '5727758a-6653-4cdc-badb-a0281d10b515', 'f77ec409-279e-411a-8ee2-3b06bb88055b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:23 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:23 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:23 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp" returned: 0 in 0.333s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp Nov 05 08:36:24 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:24 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Deleted volume successfully. Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-904ef4ab-b369-4478-8072-c868109f7864 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-2631c642-9e32-4151-84ea-604a2edc790b-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:24 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp" returned: 1 in 0.337s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12945d06-1f69-405e-9cbe-b49645142d8a_mb3qd5fp' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d096af87-18a7-46d3-830e-48bcaabf84f6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD Nov 05 08:36:24 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (868d9bf2-a53a-4d2c-a264-0cd80ed19e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d38e08-7dd2-47c6-96c3-0b6f2d1a62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:24 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d38e08-7dd2-47c6-96c3-0b6f2d1a62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486973615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a6eb36-09c4-4911-b8aa-0ed4639202a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:25Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84c1394-0878-4247-9f00-97bf39397348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84c1394-0878-4247-9f00-97bf39397348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57368eff-5daf-4f5f-9968-d1fea492d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57368eff-5daf-4f5f-9968-d1fea492d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a6eb36-09c4-4911-b8aa-0ed4639202a4', 'volume_name': 'volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b75ef2b-060e-4dec-8f5b-2941612611a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b75ef2b-060e-4dec-8f5b-2941612611a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b04cd1-4688-4f3d-85da-b1d1cf1dac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Volume f8a6eb36-09c4-4911-b8aa-0ed4639202a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4', 'volume_size': 1} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486973615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a6eb36-09c4-4911-b8aa-0ed4639202a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:25Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Creating volume f8a6eb36-09c4-4911-b8aa-0ed4639202a4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:24 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] 12945d06-1f69-405e-9cbe-b49645142d8a was qcow2, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:36:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:24 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 1073741824 Nov 05 08:36:24 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:24 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac Nov 05 08:36:24 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:25 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 1073741824" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:25 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 Nov 05 08:36:25 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:25 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b04cd1-4688-4f3d-85da-b1d1cf1dac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe15532-96fe-44e1-8862-d0a5073e5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Volume volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 (f8a6eb36-09c4-4911-b8aa-0ed4639202a4): created successfully Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe15532-96fe-44e1-8862-d0a5073e5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (868d9bf2-a53a-4d2c-a264-0cd80ed19e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-da869bdd-09de-4a91-8c3d-4ff6c0c4a07f tempest-ProjectReaderTests-1214882925 None] Created volume successfully. Nov 05 08:36:26 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac" returned: 0 in 1.850s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12945d06-1f69-405e-9cbe-b49645142d8a_cb3euseidevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:36:26 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Converted 112.00 MB image at 60.52 MB/s Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:26 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1G Nov 05 08:36:26 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-f8a6eb36-09c4-4911-b8aa-0ed4639202a4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-f8a6eb36-09c4-4911-b8aa-0ed4639202a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-quobyte-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db9ddea-f0e2-40fe-9a3e-0e98a542305d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:26 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac 1G" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Downloaded image 12945d06-1f69-405e-9cbe-b49645142d8a ((None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}])) to volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Temporary image 12945d06-1f69-405e-9cbe-b49645142d8a for user e5f7cc1db69b41b390c844679085f20f is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Marking volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Copying metadata from image 12945d06-1f69-405e-9cbe-b49645142d8a to 54c8fed5-672f-4461-ac65-fbf9d531c2ac. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:36:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Creating volume glance metadata for volume 54c8fed5-672f-4461-ac65-fbf9d531c2ac backed by image 12945d06-1f69-405e-9cbe-b49645142d8a with: {'image_id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'image_name': 'tempest-scenario-img--567060437', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:36:26 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 Nov 05 08:36:26 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecd3607-f01a-4dbe-bdd9-bac6080021f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac', 'volume_size': 1, 'image_id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12945d06-1f69-405e-9cbe-b49645142d8a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567060437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '96391469024d4dc0b3449b9ed50b07f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12945d06-1f69-405e-9cbe-b49645142d8a', 'created_at': datetime.datetime(2026, 11, 5, 7, 36, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 36, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12945d06-1f69-405e-9cbe-b49645142d8a/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e8202-9b3d-44ad-a098-53eb9852821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Volume volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac (54c8fed5-672f-4461-ac65-fbf9d531c2ac): created successfully Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e8202-9b3d-44ad-a098-53eb9852821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Flow 'volume_create_manager' (0ae1334d-3db1-49d9-a486-7f33b6c3e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c206900e-3551-4502-8dea-a39f80cc2f17 tempest-TestInstancesWithCinderVolumes-1278075106 None] Created volume successfully. Nov 05 08:36:27 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:27 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4 Nov 05 08:36:27 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:27 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-f8a6eb36-09c4-4911-b8aa-0ed4639202a4" released by "delete_volume" :: held 0.678s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Created reservations ['2fbb2494-0504-4c97-8259-2aa5507bc052', '99836af2-2cf3-4f72-925f-efb48b969e80', 'd433e0cf-f7b5-4d55-bfbc-f97def2e7de8', '348c43ae-b17c-4e6b-825b-2ddd36306487'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:27 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:27 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:27 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Deleted volume successfully. Nov 05 08:36:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-777f3498-ed0f-4c69-a715-23d437e8f962 tempest-ProjectReaderTests-1214882925 None] Lock "cinder-f8a6eb36-09c4-4911-b8aa-0ed4639202a4-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (1edb30b4-cb8c-43fa-b5b1-f7e2b31be0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1e4904-0c42-4588-bbb9-f592548124c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1e4904-0c42-4588-bbb9-f592548124c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739563884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78d08e0-81fc-4f8e-a4c0-66bdbc477332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:28Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d79a360-a709-4b0b-aee5-59eb206e2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d79a360-a709-4b0b-aee5-59eb206e2171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4efce-a9b8-4075-bbcd-74c7e7c9e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4efce-a9b8-4075-bbcd-74c7e7c9e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78d08e0-81fc-4f8e-a4c0-66bdbc477332', 'volume_name': 'volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42142ad-7c7c-4537-ab51-5b4d704c9715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42142ad-7c7c-4537-ab51-5b4d704c9715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db384fdb-63ca-4f31-90f9-e860a0b877c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Volume d78d08e0-81fc-4f8e-a4c0-66bdbc477332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332', 'volume_size': 1} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1739563884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78d08e0-81fc-4f8e-a4c0-66bdbc477332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9718cbddb7ab4379b1f59567dac2c97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:36:28Z,use_quota=True,user_id='384bf3e9e2e3449a87376de9358d35c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Creating volume d78d08e0-81fc-4f8e-a4c0-66bdbc477332 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:36:28 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:28 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 1073741824 Nov 05 08:36:28 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:28 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 1073741824" returned: 0 in 0.461s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:29 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 Nov 05 08:36:29 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:29 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db384fdb-63ca-4f31-90f9-e860a0b877c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3edb60-0445-41ed-9b4f-e01e2e48b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:36:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Volume volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 (d78d08e0-81fc-4f8e-a4c0-66bdbc477332): created successfully Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3edb60-0445-41ed-9b4f-e01e2e48b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:36:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Flow 'volume_create_manager' (1edb30b4-cb8c-43fa-b5b1-f7e2b31be0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:36:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c561b03b-a912-44e2-a20e-23b4f16faeae tempest-ProjectReaderTests-1214882925 None] Created volume successfully. Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f4ccc4fb-c168-4f73-a92b-f27dfdcbf27a req-8a98ca4b-642d-49fc-b89d-0652edae5eab tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f4ccc4fb-c168-4f73-a92b-f27dfdcbf27a req-8a98ca4b-642d-49fc-b89d-0652edae5eab tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-f4ccc4fb-c168-4f73-a92b-f27dfdcbf27a req-8a98ca4b-642d-49fc-b89d-0652edae5eab tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-f4ccc4fb-c168-4f73-a92b-f27dfdcbf27a req-8a98ca4b-642d-49fc-b89d-0652edae5eab tempest-TestInstancesWithCinderVolumes-1278075106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13420bec-6124-46d1-ade4-7ee3e965bddd', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:36:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-f4ccc4fb-c168-4f73-a92b-f27dfdcbf27a req-8a98ca4b-642d-49fc-b89d-0652edae5eab tempest-TestInstancesWithCinderVolumes-1278075106 None] attachment_update completed successfully. Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-d78d08e0-81fc-4f8e-a4c0-66bdbc477332-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "cinder-d78d08e0-81fc-4f8e-a4c0-66bdbc477332-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Acquiring lock "cinder-quobyte-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ea8d19-47d5-4d69-b649-10e5ed2ac781]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:36:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:30 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 Nov 05 08:36:30 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:31 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:31 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332 Nov 05 08:36:31 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:31 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "cinder-quobyte-d78d08e0-81fc-4f8e-a4c0-66bdbc477332" released by "delete_volume" :: held 0.713s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Created reservations ['fd2f4e96-6fbc-40e4-bb5a-023ef91d94ba', '056588d8-70bf-4588-8436-e47e9288f4d8', '35c51f49-d2d1-43d7-a395-4a0374e40c2e', '69a9c042-bca1-4797-bb79-2c982160ddd9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:36:31 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:36:31 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:36:31 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:36:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Deleted volume successfully. Nov 05 08:36:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-932d28c5-bce6-49b0-b832-c113f3fb44ad tempest-ProjectReaderTests-1214882925 None] Lock "cinder-d78d08e0-81fc-4f8e-a4c0-66bdbc477332-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:36:41 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=57,cinder:SELECT=44,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:36:41 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=48,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:37:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-884f2e17-d640-4d74-9ddf-8ff3a6f7c5b5 req-cab998ed-bfe1-4324-bb4f-b3fd4f9d65a6 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-884f2e17-d640-4d74-9ddf-8ff3a6f7c5b5 req-cab998ed-bfe1-4324-bb4f-b3fd4f9d65a6 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-884f2e17-d640-4d74-9ddf-8ff3a6f7c5b5 req-cab998ed-bfe1-4324-bb4f-b3fd4f9d65a6 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-884f2e17-d640-4d74-9ddf-8ff3a6f7c5b5 req-cab998ed-bfe1-4324-bb4f-b3fd4f9d65a6 tempest-TestInstancesWithCinderVolumes-1278075106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0385408-fce6-4ba9-b5b2-cc4ba07587d7', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:37:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-884f2e17-d640-4d74-9ddf-8ff3a6f7c5b5 req-cab998ed-bfe1-4324-bb4f-b3fd4f9d65a6 tempest-TestInstancesWithCinderVolumes-1278075106 None] attachment_update completed successfully. Nov 05 08:37:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-02c0166d-5f78-41d9-be6d-7df170085d62 req-a384f677-bb4c-4bb6-83af-627aa006b825 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-02c0166d-5f78-41d9-be6d-7df170085d62 req-a384f677-bb4c-4bb6-83af-627aa006b825 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-02c0166d-5f78-41d9-be6d-7df170085d62 req-a384f677-bb4c-4bb6-83af-627aa006b825 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-02c0166d-5f78-41d9-be6d-7df170085d62 req-a384f677-bb4c-4bb6-83af-627aa006b825 tempest-TestInstancesWithCinderVolumes-1278075106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-b1612771-cb44-441b-9273-19f1c8f3c0e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30cf17b8-3afd-4dcc-af9b-0f3cf6c81cd3', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:37:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-02c0166d-5f78-41d9-be6d-7df170085d62 req-a384f677-bb4c-4bb6-83af-627aa006b825 tempest-TestInstancesWithCinderVolumes-1278075106 None] attachment_update completed successfully. Nov 05 08:37:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ad5dd57d-586d-456f-ba6d-7bee5922d8b3 req-9021f6e7-4167-4222-a16a-5e369f25e4c0 tempest-TestInstancesWithCinderVolumes-1278075106 None] Terminate volume connection completed successfully. Nov 05 08:37:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ad5dd57d-586d-456f-ba6d-7bee5922d8b3 req-9021f6e7-4167-4222-a16a-5e369f25e4c0 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleting attachment e0385408-fce6-4ba9-b5b2-cc4ba07587d7. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-f28e4734-9b07-48d4-afa2-4bccc7f33d41-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-f28e4734-9b07-48d4-afa2-4bccc7f33d41-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-quobyte-f28e4734-9b07-48d4-afa2-4bccc7f33d41" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-f28e4734-9b07-48d4-afa2-4bccc7f33d41" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee981e2-a2b0-4b9a-a921-d878e9c778cc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:08 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 Nov 05 08:37:08 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:08 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:08 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41 Nov 05 08:37:08 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:09 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f28e4734-9b07-48d4-afa2-4bccc7f33d41" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-f28e4734-9b07-48d4-afa2-4bccc7f33d41" released by "delete_volume" :: held 0.721s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:09 devstack cinder-volume[87092]: WARNING cinder.quota [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263294145-1255609522 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263294145-1255609522, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:09 devstack cinder-volume[87092]: WARNING cinder.quota [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263294145-1255609522 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1263294145-1255609522, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Created reservations ['e9b02103-6a71-41aa-818d-a2ee7249a938', 'f96a4226-e3c9-4a42-9958-ded2466c4f56', '9312c8b5-063b-4b58-8384-2434aea70f61', 'e209f99c-a823-45e9-97d1-713fdb1f6c50'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:09 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:37:09 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:09 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleted volume successfully. Nov 05 08:37:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b34977-30a4-41a1-b183-ef2336b242cd tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-f28e4734-9b07-48d4-afa2-4bccc7f33d41-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ce1cbc6b-f04d-4c07-a113-2cdb48363aaf req-3f6bd19a-0475-441b-b1a6-4ad8c739ee06 tempest-TestInstancesWithCinderVolumes-1278075106 None] Terminate volume connection completed successfully. Nov 05 08:37:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ce1cbc6b-f04d-4c07-a113-2cdb48363aaf req-3f6bd19a-0475-441b-b1a6-4ad8c739ee06 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleting attachment 30cf17b8-3afd-4dcc-af9b-0f3cf6c81cd3. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-b1612771-cb44-441b-9273-19f1c8f3c0e9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-b1612771-cb44-441b-9273-19f1c8f3c0e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-quobyte-b1612771-cb44-441b-9273-19f1c8f3c0e9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-b1612771-cb44-441b-9273-19f1c8f3c0e9" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce79cf-5108-43ae-be5b-8c7f862641d2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:12 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 Nov 05 08:37:12 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:12 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:12 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9 Nov 05 08:37:12 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:13 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b1612771-cb44-441b-9273-19f1c8f3c0e9" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-b1612771-cb44-441b-9273-19f1c8f3c0e9" released by "delete_volume" :: held 0.669s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:13 devstack cinder-volume[87092]: WARNING cinder.quota [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757434473-643131449 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757434473-643131449, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:13 devstack cinder-volume[87092]: WARNING cinder.quota [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757434473-643131449 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1757434473-643131449, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Created reservations ['b905f4d5-3f30-4727-b961-28fc8a32ea0e', 'cd3ffd8c-62d0-4e34-8f6f-e4c78e4202b8', '408d7b14-dec7-42c6-ac3a-dc11a1651683', 'aed1a619-0285-4ec5-b413-343c82fb4209'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:13 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:37:13 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:13 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleted volume successfully. Nov 05 08:37:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-30708d3d-4c56-4103-aca6-266300964bad tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-b1612771-cb44-441b-9273-19f1c8f3c0e9-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-fc4d30d3-4b3d-4033-9310-11385df19fa2 req-a168d39e-a08d-48b4-b901-33ed897514c5 tempest-TestInstancesWithCinderVolumes-1278075106 None] Terminate volume connection completed successfully. Nov 05 08:37:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-fc4d30d3-4b3d-4033-9310-11385df19fa2 req-a168d39e-a08d-48b4-b901-33ed897514c5 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleting attachment 13420bec-6124-46d1-ade4-7ee3e965bddd. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-54c8fed5-672f-4461-ac65-fbf9d531c2ac-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-54c8fed5-672f-4461-ac65-fbf9d531c2ac-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "cinder-quobyte-54c8fed5-672f-4461-ac65-fbf9d531c2ac" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-54c8fed5-672f-4461-ac65-fbf9d531c2ac" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a2c2f-0592-4a4c-9c29-128df5ef0554]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:37:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:17 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac Nov 05 08:37:17 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:18 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:18 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac Nov 05 08:37:18 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:18 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:37:18 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:18 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-54c8fed5-672f-4461-ac65-fbf9d531c2ac" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-quobyte-54c8fed5-672f-4461-ac65-fbf9d531c2ac" released by "delete_volume" :: held 0.648s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:18 devstack cinder-volume[87092]: WARNING cinder.quota [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1323184685-95675146 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1323184685-95675146, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:18 devstack cinder-volume[87092]: WARNING cinder.quota [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1323184685-95675146 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1323184685-95675146, it is now deprecated. Please use the default quota class for default quota. Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Created reservations ['72db706b-e838-4c37-a9b9-d928550f08e0', 'c9ba38c5-fff4-4051-bfd5-b0cc21369e57', '6b41e839-04b4-4c3e-b48b-9a710b5505b8', 'adf160f1-4d92-4ef1-835f-6a9501234810'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:37:18 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:37:18 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:37:18 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:37:18 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:37:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Deleted volume successfully. Nov 05 08:37:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9d96d099-1227-44d5-b2b1-861ad3437aa9 tempest-TestInstancesWithCinderVolumes-1278075106 None] Lock "cinder-54c8fed5-672f-4461-ac65-fbf9d531c2ac-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:37:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:37:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=34,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Flow 'volume_create_manager' (6cd7f796-997a-4842-b3cc-c986b58332db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a3db34-74a8-42b2-9170-e21bc4e12800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a3db34-74a8-42b2-9170-e21bc4e12800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1738030830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510ff75a-8fc5-439b-b10c-520297540d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225cd0377c94dbdab792e23043de648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:38:01Z,use_quota=True,user_id='7e7b46d71c06465bbd3f0bdd5e860275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28bfd00-2ab3-451c-a231-08bc77915ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28bfd00-2ab3-451c-a231-08bc77915ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2549045-2d39-42a9-a48c-515937148cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2549045-2d39-42a9-a48c-515937148cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510ff75a-8fc5-439b-b10c-520297540d97', 'volume_name': 'volume-510ff75a-8fc5-439b-b10c-520297540d97', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d4dc9-730a-4fe0-b251-611ddeea9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d4dc9-730a-4fe0-b251-611ddeea9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e356f2e-76f5-4ebb-b7cc-6c3ab25fd59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:01 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Volume 510ff75a-8fc5-439b-b10c-520297540d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510ff75a-8fc5-439b-b10c-520297540d97', 'volume_size': 1} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1738030830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510ff75a-8fc5-439b-b10c-520297540d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225cd0377c94dbdab792e23043de648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:38:01Z,use_quota=True,user_id='7e7b46d71c06465bbd3f0bdd5e860275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Creating volume 510ff75a-8fc5-439b-b10c-520297540d97 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:38:01 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:01 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 1073741824 Nov 05 08:38:01 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:01 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 1073741824" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:01 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 Nov 05 08:38:01 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:02 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e356f2e-76f5-4ebb-b7cc-6c3ab25fd59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510ff75a-8fc5-439b-b10c-520297540d97', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9ec52-645a-461a-b7b4-f6154769e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:38:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Volume volume-510ff75a-8fc5-439b-b10c-520297540d97 (510ff75a-8fc5-439b-b10c-520297540d97): created successfully Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9ec52-645a-461a-b7b4-f6154769e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:38:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Flow 'volume_create_manager' (6cd7f796-997a-4842-b3cc-c986b58332db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:38:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-58f01606-4d40-4f46-9926-c4f30046341e tempest-TestMinimumBasicScenario-213133553 None] Created volume successfully. Nov 05 08:38:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c695c305-1a53-4f99-833e-7b59982f9bac req-6b58fc78-083c-4b1f-bf38-ad87e858a33a tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c695c305-1a53-4f99-833e-7b59982f9bac req-6b58fc78-083c-4b1f-bf38-ad87e858a33a tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-c695c305-1a53-4f99-833e-7b59982f9bac req-6b58fc78-083c-4b1f-bf38-ad87e858a33a tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-c695c305-1a53-4f99-833e-7b59982f9bac req-6b58fc78-083c-4b1f-bf38-ad87e858a33a tempest-TestMinimumBasicScenario-213133553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-510ff75a-8fc5-439b-b10c-520297540d97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42b418cd-63de-4d36-96c1-b1ebd9e256f2', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:38:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-c695c305-1a53-4f99-833e-7b59982f9bac req-6b58fc78-083c-4b1f-bf38-ad87e858a33a tempest-TestMinimumBasicScenario-213133553 None] attachment_update completed successfully. Nov 05 08:38:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:13 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:18 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:38:18 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:18 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:38:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:38:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-614efc1c-9429-4eeb-9c54-f42073fb6fd1 req-c9fead73-10c2-4c35-95f1-4acf1f3b1c6d tempest-TestMinimumBasicScenario-213133553 None] Terminate volume connection completed successfully. Nov 05 08:38:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-614efc1c-9429-4eeb-9c54-f42073fb6fd1 req-c9fead73-10c2-4c35-95f1-4acf1f3b1c6d tempest-TestMinimumBasicScenario-213133553 None] Deleting attachment 42b418cd-63de-4d36-96c1-b1ebd9e256f2. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:38:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "cinder-510ff75a-8fc5-439b-b10c-520297540d97-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "cinder-510ff75a-8fc5-439b-b10c-520297540d97-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "cinder-quobyte-510ff75a-8fc5-439b-b10c-520297540d97" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "cinder-quobyte-510ff75a-8fc5-439b-b10c-520297540d97" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb1b64-c5bd-4569-97e0-d04436829889]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:49 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 Nov 05 08:38:49 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:49 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97" returned: 0 in 0.367s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:49 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97 Nov 05 08:38:49 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:49 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-510ff75a-8fc5-439b-b10c-520297540d97" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "cinder-quobyte-510ff75a-8fc5-439b-b10c-520297540d97" released by "delete_volume" :: held 0.653s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Created reservations ['af719f88-6fc9-4184-b169-8bce04048b43', 'd4cf1574-eb8d-4eba-86dc-c4c3c0cf7115', 'bad4c528-31ba-46ae-accd-07f081d9b9ca', '7d7d5eef-d289-4a03-b7f6-150bd7f89120'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:38:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:38:49 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:38:49 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:38:50 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Nov 05 08:38:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:38:50 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:38:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Deleted volume successfully. Nov 05 08:38:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-003c9a48-4e56-4191-892c-f5e0e4a76028 tempest-TestMinimumBasicScenario-213133553 None] Lock "cinder-510ff75a-8fc5-439b-b10c-520297540d97-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:38:59 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:00 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:18 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:39:18 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:18 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:39:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Flow 'volume_create_manager' (50171012-fa31-4620-aa88-e8d8de7156ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d82ae6-394d-4c2d-b37d-26c48ae534db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d82ae6-394d-4c2d-b37d-26c48ae534db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1007598378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1511ebe7d7fa40198293515aa40d7760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:23Z,use_quota=True,user_id='45b7d6ff7b9646e988dd6792e589bc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da98085-bf5a-4a8f-833e-b0539d09e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da98085-bf5a-4a8f-833e-b0539d09e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7183488-e13b-4e52-a4d5-3460ee613baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7183488-e13b-4e52-a4d5-3460ee613baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a', 'volume_name': 'volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66adb85-04a0-4eb0-9590-965e2768df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66adb85-04a0-4eb0-9590-965e2768df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c149ab3-e3b9-49d6-982e-cbfc8f85a1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Volume ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a', 'volume_size': 1} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1007598378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1511ebe7d7fa40198293515aa40d7760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:39:23Z,use_quota=True,user_id='45b7d6ff7b9646e988dd6792e589bc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Creating volume ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:39:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:23 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a 1073741824 Nov 05 08:39:23 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:23 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a 1073741824" returned: 0 in 0.469s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:23 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:39:23 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:23 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c149ab3-e3b9-49d6-982e-cbfc8f85a1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f338717e-6608-4ed3-a4f4-c825b5de1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:39:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Volume volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a (ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a): created successfully Nov 05 08:39:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f338717e-6608-4ed3-a4f4-c825b5de1631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:39:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Flow 'volume_create_manager' (50171012-fa31-4620-aa88-e8d8de7156ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:39:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-402b2620-b077-4498-b991-0e5ba1e2b52b tempest-TestStampPattern-2099297495 None] Created volume successfully. Nov 05 08:39:33 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:34 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:39:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-12832274-2f66-4ba3-9233-a5085ccce3bf req-caa4961f-128e-4b42-bc5c-8a6be6f6d8fc tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-12832274-2f66-4ba3-9233-a5085ccce3bf req-caa4961f-128e-4b42-bc5c-8a6be6f6d8fc tempest-TestStampPattern-2099297495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-12832274-2f66-4ba3-9233-a5085ccce3bf req-caa4961f-128e-4b42-bc5c-8a6be6f6d8fc tempest-TestStampPattern-2099297495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-12832274-2f66-4ba3-9233-a5085ccce3bf req-caa4961f-128e-4b42-bc5c-8a6be6f6d8fc tempest-TestStampPattern-2099297495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ca82fbe-f4e6-456c-abee-b82893908a51', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:39:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-12832274-2f66-4ba3-9233-a5085ccce3bf req-caa4961f-128e-4b42-bc5c-8a6be6f6d8fc tempest-TestStampPattern-2099297495 None] attachment_update completed successfully. Nov 05 08:39:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-ccdeb89a-7810-4aea-8611-1b892b1105cd req-141a107f-336c-4a53-91b9-9630864e173c tempest-TestStampPattern-2099297495 None] Terminate volume connection completed successfully. Nov 05 08:39:56 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-ccdeb89a-7810-4aea-8611-1b892b1105cd req-141a107f-336c-4a53-91b9-9630864e173c tempest-TestStampPattern-2099297495 None] Deleting attachment 2ca82fbe-f4e6-456c-abee-b82893908a51. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:39:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:39:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:39:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Creating offline snapshot 842b74d5-1c33-4af2-bab8-c194d17771e6 of volume ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:39:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c4732-d2c7-42c1-aea5-d74ab745114e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:39:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:57 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:39:57 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:58 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.373s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:58 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 1G Nov 05 08:39:58 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:58 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 1G" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:58 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:39:58 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:58 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.290s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:58 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 is being set with open permissions: ugo+rw Nov 05 08:39:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:58 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:39:58 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:59 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:59 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info Nov 05 08:39:59 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:59 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:59 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info is being set with open permissions: ugo+rw Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:39:59 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info Nov 05 08:39:59 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:39:59 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.info" returned: 0 in 0.236s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:39:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:39:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-66c58bca-3d0f-4c88-b69c-57803c2b9cd2 tempest-TestStampPattern-2099297495 None] Create snapshot completed successfully Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Flow 'volume_create_manager' (21cde759-d3b3-464a-9af4-89719758c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0ecc5-d387-4f2a-9244-484aee017927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0ecc5-d387-4f2a-9244-484aee017927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-751841550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177420d-d061-4c94-8779-6af1cd69ef80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1511ebe7d7fa40198293515aa40d7760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=842b74d5-1c33-4af2-bab8-c194d17771e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:40:06Z,use_quota=True,user_id='45b7d6ff7b9646e988dd6792e589bc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dfe2d4-2966-43ed-b603-e2409bd695dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dfe2d4-2966-43ed-b603-e2409bd695dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78a059-1b35-4100-88d1-4ca6589e3a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be78a059-1b35-4100-88d1-4ca6589e3a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9177420d-d061-4c94-8779-6af1cd69ef80', 'volume_name': 'volume-9177420d-d061-4c94-8779-6af1cd69ef80', 'volume_size': 1, 'snapshot_id': '842b74d5-1c33-4af2-bab8-c194d17771e6'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c6b7ea-0ebe-47ff-9577-271aa7ec5926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c6b7ea-0ebe-47ff-9577-271aa7ec5926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1b81cf-fbb3-4881-8190-f4ea4ecaa993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Volume 9177420d-d061-4c94-8779-6af1cd69ef80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9177420d-d061-4c94-8779-6af1cd69ef80', 'volume_size': 1, 'snapshot_id': '842b74d5-1c33-4af2-bab8-c194d17771e6'} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6-9177420d-d061-4c94-8779-6af1cd69ef80" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6-9177420d-d061-4c94-8779-6af1cd69ef80" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Creating volume 9177420d-d061-4c94-8779-6af1cd69ef80 from snapshot 842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] snapshot: 842b74d5-1c33-4af2-bab8-c194d17771e6, volume: 9177420d-d061-4c94-8779-6af1cd69ef80, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[15be588c-a0a7-4dbf-a3f6-db9ce9db8548]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:06 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:40:06 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:07 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcaa6cc-e4aa-45cf-b30d-31c7cc128c1d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:07 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:40:07 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:07 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:40:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:07 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 Nov 05 08:40:07 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:16 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80" returned: 0 in 8.721s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:40:16 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Converted 1024.00 MB image at 117.40 MB/s Nov 05 08:40:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 is being set with open permissions: ugo+rw Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:16 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 Nov 05 08:40:16 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:16 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" released by "_copy_volume_from_snapshot" :: held 9.950s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6-9177420d-d061-4c94-8779-6af1cd69ef80" released by "_create_volume_from_snapshot" :: held 10.042s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.060s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1b81cf-fbb3-4881-8190-f4ea4ecaa993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9177420d-d061-4c94-8779-6af1cd69ef80', 'volume_size': 1, 'snapshot_id': '842b74d5-1c33-4af2-bab8-c194d17771e6'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a516e3-4c39-4120-a6d4-a512656473f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:40:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Volume volume-9177420d-d061-4c94-8779-6af1cd69ef80 (9177420d-d061-4c94-8779-6af1cd69ef80): created successfully Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a516e3-4c39-4120-a6d4-a512656473f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:40:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Flow 'volume_create_manager' (21cde759-d3b3-464a-9af4-89719758c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:40:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bc1e6842-718d-4b42-ba21-db9acb173691 tempest-TestStampPattern-2099297495 None] Created volume successfully. Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:18 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:40:18 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:18 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.328s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:40:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:40:26 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:26 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:40:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf58183e-29ac-4865-9a06-60b31eeb5737 req-30f1ebd8-5eda-412a-a1e9-2ea9ecb0daae tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf58183e-29ac-4865-9a06-60b31eeb5737 req-30f1ebd8-5eda-412a-a1e9-2ea9ecb0daae tempest-TestStampPattern-2099297495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [req-bf58183e-29ac-4865-9a06-60b31eeb5737 req-30f1ebd8-5eda-412a-a1e9-2ea9ecb0daae tempest-TestStampPattern-2099297495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-bf58183e-29ac-4865-9a06-60b31eeb5737 req-30f1ebd8-5eda-412a-a1e9-2ea9ecb0daae tempest-TestStampPattern-2099297495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee', 'name': 'volume-9177420d-d061-4c94-8779-6af1cd69ef80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e8a17b9-3cd1-4c88-9265-19f8c2bd0882', 'enforce_multipath': True} {{(pid=87092) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 08:40:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-bf58183e-29ac-4865-9a06-60b31eeb5737 req-30f1ebd8-5eda-412a-a1e9-2ea9ecb0daae tempest-TestStampPattern-2099297495 None] attachment_update completed successfully. Nov 05 08:40:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [req-7f93ffa2-fa91-48bc-87dd-97919c662af6 req-7e2e9f02-a59b-4b58-9e9f-c551f9d2d23f tempest-TestStampPattern-2099297495 None] Terminate volume connection completed successfully. Nov 05 08:40:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [req-7f93ffa2-fa91-48bc-87dd-97919c662af6 req-7e2e9f02-a59b-4b58-9e9f-c551f9d2d23f tempest-TestStampPattern-2099297495 None] Deleting attachment 6e8a17b9-3cd1-4c88-9265-19f8c2bd0882. {{(pid=87092) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-9177420d-d061-4c94-8779-6af1cd69ef80-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "cinder-9177420d-d061-4c94-8779-6af1cd69ef80-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d66c7-d174-4ca3-a00f-6a46f36b0432]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:48 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 Nov 05 08:40:48 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:48 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:48 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80 Nov 05 08:40:48 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:48 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9177420d-d061-4c94-8779-6af1cd69ef80" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-9177420d-d061-4c94-8779-6af1cd69ef80" released by "delete_volume" :: held 0.653s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Created reservations ['4fdb8956-c083-4e0f-a459-3452eaf7d1c5', '846bab46-e960-4737-a839-4617e0f71083', '1e0d5de8-d5d0-4fb1-a72d-4ff021cb65aa', 'aa48c038-f7fe-4dee-909d-87d6895f2fcc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:49 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:40:49 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:49 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Deleted volume successfully. Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3f0e40fc-d149-4147-8bd0-6ebedeef6f2a tempest-TestStampPattern-2099297495 None] Lock "cinder-9177420d-d061-4c94-8779-6af1cd69ef80-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-842b74d5-1c33-4af2-bab8-c194d17771e6-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-842b74d5-1c33-4af2-bab8-c194d17771e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Deleting offline snapshot 842b74d5-1c33-4af2-bab8-c194d17771e6 of volume ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] snapshot_file for this snap is: volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111c47c-b863-474d-88a5-5050256e374f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:49 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:40:49 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:50 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.359s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e5aecb-f65e-4ec8-bf18-6f635b9db437]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:50 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:40:50 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:50 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.553s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:50 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:40:50 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:51 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:51 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6 Nov 05 08:40:51 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:51 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a.842b74d5-1c33-4af2-bab8-c194d17771e6" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-842b74d5-1c33-4af2-bab8-c194d17771e6" released by "_delete_snapshot" :: held 1.609s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" released by "delete_snapshot" :: held 1.633s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Created reservations ['b30934bd-fdc6-45fa-9382-1f2ad75d6b1a', 'b8033dc9-dc74-4ef7-a206-2211b8139ff4', '0b1e7813-700d-4521-990c-aa3bd26e41bd', 'b93fd026-3c5b-4a6e-b72a-f1a4d05cb548'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Delete snapshot completed successfully. Nov 05 08:40:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-14af6283-ad7b-4ec0-b70a-c3b75535050c tempest-TestStampPattern-2099297495 None] Lock "cinder-842b74d5-1c33-4af2-bab8-c194d17771e6-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "cinder-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Acquiring lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74ef80c-8963-4a66-8034-aa7f81b403d8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:55 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:40:55 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:55 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:55 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a Nov 05 08:40:55 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:55 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "cinder-quobyte-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a" released by "delete_volume" :: held 0.654s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Created reservations ['3a7fc172-ff14-4680-b2c0-c488f44d288c', '3a1a109e-6dfa-40cb-839e-86c8b701cc8a', 'af1ed491-7fc5-4f7d-a9e6-a1c290414859', '2e1821ec-8060-4531-8ba6-e88f2a4bdeb2'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:40:56 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:40:56 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:40:56 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:40:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Deleted volume successfully. Nov 05 08:40:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5a9dcd41-ffc3-4d48-8ef2-1b65c3bd0907 tempest-TestStampPattern-2099297495 None] Lock "cinder-ea5fd1b3-6bb3-4bec-b361-60f7e6b45c3a-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:06 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:06 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (91b20a2a-d555-40df-85da-14f340c90c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca370dba-eadb-4e1c-a633-5c0cc2e0156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca370dba-eadb-4e1c-a633-5c0cc2e0156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739284765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220e6551-5132-44da-98e3-1d0cf86d0348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:08Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18975dd4-c67f-438f-a84c-4ef75815c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18975dd4-c67f-438f-a84c-4ef75815c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf573580-b389-4fd3-a29c-50efff9fe29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf573580-b389-4fd3-a29c-50efff9fe29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220e6551-5132-44da-98e3-1d0cf86d0348', 'volume_name': 'volume-220e6551-5132-44da-98e3-1d0cf86d0348', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0425a0-b0f2-40e3-bdd3-e99a3636119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0425a0-b0f2-40e3-bdd3-e99a3636119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f14c2-d693-42f4-84d6-20390fb7d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Volume 220e6551-5132-44da-98e3-1d0cf86d0348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220e6551-5132-44da-98e3-1d0cf86d0348', 'volume_size': 1} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739284765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220e6551-5132-44da-98e3-1d0cf86d0348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:08Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Creating volume 220e6551-5132-44da-98e3-1d0cf86d0348 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:07 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:07 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 1073741824 Nov 05 08:41:07 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (91eae073-dfe0-4334-b0d2-ccf4e9e3404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8663af-2b06-4c0d-a60e-49d386643217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8663af-2b06-4c0d-a60e-49d386643217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466325573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a22d6c-9673-429b-a332-81f853102a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:08Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463962fc-2ab4-434e-b300-eed9e6a0bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463962fc-2ab4-434e-b300-eed9e6a0bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f03b02-a157-45de-ae7e-32bcd2eb0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f03b02-a157-45de-ae7e-32bcd2eb0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a22d6c-9673-429b-a332-81f853102a64', 'volume_name': 'volume-b6a22d6c-9673-429b-a332-81f853102a64', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6979ec-8c49-422c-b56c-7e4a9d0a9818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6979ec-8c49-422c-b56c-7e4a9d0a9818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5eb93a-1749-4473-aab2-b0561c63ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Volume b6a22d6c-9673-429b-a332-81f853102a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a22d6c-9673-429b-a332-81f853102a64', 'volume_size': 1} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:08 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 1073741824" returned: 0 in 0.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:08 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 Nov 05 08:41:08 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:08 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348" returned: 0 in 0.302s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466325573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a22d6c-9673-429b-a332-81f853102a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:08Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Creating volume b6a22d6c-9673-429b-a332-81f853102a64 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f14c2-d693-42f4-84d6-20390fb7d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220e6551-5132-44da-98e3-1d0cf86d0348', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 1073741824 Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e457d0-1aa5-442c-9852-d7220311fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (adff0528-a7c3-4647-a6b2-7a8fbad567e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0efc05f-ce11-41cf-9716-70e1cb18391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0efc05f-ce11-41cf-9716-70e1cb18391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151037370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e6a704-b36a-445b-bc9d-19129be58dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8688ef9a-b3c7-4307-ae80-4edb246055fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8688ef9a-b3c7-4307-ae80-4edb246055fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f896aa1c-a1cb-4e1d-94b3-5cc0da9ddf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f896aa1c-a1cb-4e1d-94b3-5cc0da9ddf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e6a704-b36a-445b-bc9d-19129be58dfc', 'volume_name': 'volume-f2e6a704-b36a-445b-bc9d-19129be58dfc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624482dc-9deb-4de8-b65f-d296ac925da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624482dc-9deb-4de8-b65f-d296ac925da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962bff21-8319-4524-ba63-77afdf8d3028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Volume f2e6a704-b36a-445b-bc9d-19129be58dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e6a704-b36a-445b-bc9d-19129be58dfc', 'volume_size': 1} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Volume volume-220e6551-5132-44da-98e3-1d0cf86d0348 (220e6551-5132-44da-98e3-1d0cf86d0348): created successfully Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e457d0-1aa5-442c-9852-d7220311fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (91b20a2a-d555-40df-85da-14f340c90c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-572450f0-4dd4-4c61-91c9-514e9eabb08f tempest-CreateVolumesFromImageTest-880629263 None] Created volume successfully. Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (0261c029-d2cc-4470-b0b6-135d4bcf5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324804b9-b334-4298-9592-b5f082110054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324804b9-b334-4298-9592-b5f082110054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051970851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34979418-42da-4e86-9816-8903e6efd499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7086144d-5015-4339-86e8-f2be5b31e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7086144d-5015-4339-86e8-f2be5b31e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14072908-516a-49bd-86f0-e16344cabc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14072908-516a-49bd-86f0-e16344cabc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34979418-42da-4e86-9816-8903e6efd499', 'volume_name': 'volume-34979418-42da-4e86-9816-8903e6efd499', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4ebcaf-c592-401d-9de9-4f2a7a291472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4ebcaf-c592-401d-9de9-4f2a7a291472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c6b25-fe2b-4291-b297-425fc960396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Volume 34979418-42da-4e86-9816-8903e6efd499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34979418-42da-4e86-9816-8903e6efd499', 'volume_size': 1} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:09 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 1073741824" returned: 0 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:09 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 Nov 05 08:41:09 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (f8eed73d-ec85-48f8-8aa1-768d752314d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e45119-f201-45a2-b998-67570c456717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e45119-f201-45a2-b998-67570c456717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728783815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf968c8a-4be7-468f-b417-a4f6152550d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf968c8a-4be7-468f-b417-a4f6152550d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67920da7-8d50-496f-95a2-8bcfabdbfcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67920da7-8d50-496f-95a2-8bcfabdbfcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44', 'volume_name': 'volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090397d-9711-4d62-a4bf-7ac112483808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090397d-9711-4d62-a4bf-7ac112483808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa23382-ded5-4199-9277-5427549a4712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Volume 2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44', 'volume_size': 1} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:09 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1151037370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e6a704-b36a-445b-bc9d-19129be58dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Creating volume f2e6a704-b36a-445b-bc9d-19129be58dfc {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:09 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5eb93a-1749-4473-aab2-b0561c63ab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a22d6c-9673-429b-a332-81f853102a64', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d711ee06-0c1c-4be7-8315-2950102aa2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:09 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc 1073741824 Nov 05 08:41:09 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Volume volume-b6a22d6c-9673-429b-a332-81f853102a64 (b6a22d6c-9673-429b-a332-81f853102a64): created successfully Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d711ee06-0c1c-4be7-8315-2950102aa2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (91eae073-dfe0-4334-b0d2-ccf4e9e3404a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4c1c8e7d-53fc-4faa-a9e8-c30a15237d34 tempest-CreateVolumesFromImageTest-880629263 None] Created volume successfully. Nov 05 08:41:10 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc 1073741824" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:10 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc Nov 05 08:41:10 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:10 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1051970851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34979418-42da-4e86-9816-8903e6efd499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Creating volume 34979418-42da-4e86-9816-8903e6efd499 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:10 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962bff21-8319-4524-ba63-77afdf8d3028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e6a704-b36a-445b-bc9d-19129be58dfc', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d47884e-2688-4689-abe0-ba55fdc9336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:10 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 1073741824 Nov 05 08:41:10 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:10 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Volume volume-f2e6a704-b36a-445b-bc9d-19129be58dfc (f2e6a704-b36a-445b-bc9d-19129be58dfc): created successfully Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d47884e-2688-4689-abe0-ba55fdc9336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (adff0528-a7c3-4647-a6b2-7a8fbad567e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3de9647f-4c67-4628-abe5-580315f71667 tempest-CreateVolumesFromImageTest-880629263 None] Created volume successfully. Nov 05 08:41:10 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 1073741824" returned: 0 in 0.442s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:10 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 Nov 05 08:41:10 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:11 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1728783815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfce8bfa657414c9b3300ffb01f6b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:09Z,use_quota=True,user_id='a562373128c244e4960e27e3c199323e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Creating volume 2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:11 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3c6b25-fe2b-4291-b297-425fc960396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34979418-42da-4e86-9816-8903e6efd499', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa3384c-166c-4eb5-9bfc-589af846cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:11 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 1073741824 Nov 05 08:41:11 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Volume volume-34979418-42da-4e86-9816-8903e6efd499 (34979418-42da-4e86-9816-8903e6efd499): created successfully Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa3384c-166c-4eb5-9bfc-589af846cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (0261c029-d2cc-4470-b0b6-135d4bcf5907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b6cdec46-0f27-468d-ba32-25f75a12efda tempest-CreateVolumesFromImageTest-880629263 None] Created volume successfully. Nov 05 08:41:11 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 1073741824" returned: 0 in 0.434s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:11 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 Nov 05 08:41:11 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:11 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa23382-ded5-4199-9277-5427549a4712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb7489f-3e0b-4c59-a84b-83e7c1e02a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:11 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Volume volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 (2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44): created successfully Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb7489f-3e0b-4c59-a84b-83e7c1e02a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Flow 'volume_create_manager' (f8eed73d-ec85-48f8-8aa1-768d752314d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-af7a6def-87aa-4233-8e53-d020706f5027 tempest-CreateVolumesFromImageTest-880629263 None] Created volume successfully. Nov 05 08:41:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-quobyte-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:12 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f469ab-4639-433f-9697-8aebdb8bb4ff]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:13 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 Nov 05 08:41:13 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:13 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" returned: 0 in 0.376s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:13 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44 Nov 05 08:41:13 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:13 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" returned: 0 in 0.239s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44" released by "delete_volume" :: held 0.657s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Created reservations ['5a5d57ae-b687-4615-9b29-5431a06d314e', '58492f8b-dfd6-4379-b16e-302d1213df2f', '7a25ed49-f916-49c3-b409-943129082fe3', 'eb692b04-f6b2-4f9e-a248-f504a1c7d22b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:13 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:13 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:14 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:14 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Deleted volume successfully. Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3e2ecf93-7705-40a2-94c0-a9c439b3be7f tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-2fc8e3d4-ca6b-4497-bfa8-ef7135ae2a44-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-34979418-42da-4e86-9816-8903e6efd499-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-34979418-42da-4e86-9816-8903e6efd499-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-quobyte-34979418-42da-4e86-9816-8903e6efd499" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-34979418-42da-4e86-9816-8903e6efd499" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fd2e3-6518-4152-ac4b-503c1a7a5d75]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:14 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 Nov 05 08:41:14 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:14 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499" returned: 0 in 0.357s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:14 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499 Nov 05 08:41:14 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:14 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-34979418-42da-4e86-9816-8903e6efd499" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-34979418-42da-4e86-9816-8903e6efd499" released by "delete_volume" :: held 0.636s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Created reservations ['d6d4a5c8-1c49-44ae-800b-64441924cf57', '5cc37f9c-b6b6-46ed-951b-26b0ebf68f6c', '36d8e209-6131-4018-a5f1-122a24aad488', 'a33f4744-64c0-4997-b93d-6b9724fe2329'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:14 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:14 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:15 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Deleted volume successfully. Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f811465e-e0a8-4abd-9214-3d88ec8bd56d tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-34979418-42da-4e86-9816-8903e6efd499-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-f2e6a704-b36a-445b-bc9d-19129be58dfc-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-f2e6a704-b36a-445b-bc9d-19129be58dfc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-quobyte-f2e6a704-b36a-445b-bc9d-19129be58dfc" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-f2e6a704-b36a-445b-bc9d-19129be58dfc" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251a23c-680d-4b91-800b-791a363b047e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:15 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc Nov 05 08:41:15 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:15 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:15 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc Nov 05 08:41:15 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:15 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f2e6a704-b36a-445b-bc9d-19129be58dfc" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-f2e6a704-b36a-445b-bc9d-19129be58dfc" released by "delete_volume" :: held 0.641s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Created reservations ['01b2bfd1-c228-439b-b18a-d9ffb1cf85b7', 'e7fcc1d8-2a18-45d8-9db5-685f229527d7', '3cdb3246-90dc-4dee-82b0-abb120f08194', '79b43a11-4bf4-47cf-8dd2-006e39d247a7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:16 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:16 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:16 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Deleted volume successfully. Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-31c6a13b-2bae-45aa-b632-c6d2de4c952c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-f2e6a704-b36a-445b-bc9d-19129be58dfc-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-b6a22d6c-9673-429b-a332-81f853102a64-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-b6a22d6c-9673-429b-a332-81f853102a64-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-quobyte-b6a22d6c-9673-429b-a332-81f853102a64" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-b6a22d6c-9673-429b-a332-81f853102a64" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2cb892-373a-4620-9370-d71d694aba78]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:16 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 Nov 05 08:41:16 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:16 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:16 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64 Nov 05 08:41:16 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:17 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-b6a22d6c-9673-429b-a332-81f853102a64" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-b6a22d6c-9673-429b-a332-81f853102a64" released by "delete_volume" :: held 0.645s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Created reservations ['47fd04b4-defc-424c-8a76-748d5ae0715d', '949eb24a-d38c-4ce4-9c27-90de3f2775dc', '4b53e321-9ad5-4182-8bc3-8447b124e986', '8d2845ab-cee6-4e4f-8c2e-c72dc07a92e9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:17 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:17 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:17 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Deleted volume successfully. Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b8ebc614-e0b3-4e01-b164-66372cef73f1 tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-b6a22d6c-9673-429b-a332-81f853102a64-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-220e6551-5132-44da-98e3-1d0cf86d0348-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-220e6551-5132-44da-98e3-1d0cf86d0348-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "cinder-quobyte-220e6551-5132-44da-98e3-1d0cf86d0348" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-220e6551-5132-44da-98e3-1d0cf86d0348" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31194de-c884-41b0-9256-36df1f773cca]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:17 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 Nov 05 08:41:17 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:17 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:18 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348 Nov 05 08:41:18 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:18 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-220e6551-5132-44da-98e3-1d0cf86d0348" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-quobyte-220e6551-5132-44da-98e3-1d0cf86d0348" released by "delete_volume" :: held 0.668s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:18 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:18 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Created reservations ['38ee6da8-d376-4978-88e4-4d95f86a69b5', '14f63d14-2a13-4adb-8c03-2ec90e21af41', 'e0e89195-9c83-4a30-baac-129f4d27933f', 'cee95571-5bdc-40f1-86ff-e8bec02f3fec'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:18 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:18 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:18 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:41:18 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Deleted volume successfully. Nov 05 08:41:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-09313e31-fc49-4bbc-a574-793c168af15c tempest-CreateVolumesFromImageTest-880629263 None] Lock "cinder-220e6551-5132-44da-98e3-1d0cf86d0348-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Flow 'volume_create_manager' (5a538797-a018-4159-ae61-8b28bb80ddd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2dfc59-d0b5-4abf-a663-ef5e9a469799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2dfc59-d0b5-4abf-a663-ef5e9a469799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b31181b-dd30-4524-832c-5061de4007e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d426fdf60d9b42edbe9942e58267ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:21Z,use_quota=True,user_id='2f4c3d4a5aee4414856217f97b55ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be655dc4-799f-4310-b272-0f19eda8283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be655dc4-799f-4310-b272-0f19eda8283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d744fa61-cb76-4e97-9fa5-f8fced16d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d744fa61-cb76-4e97-9fa5-f8fced16d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b31181b-dd30-4524-832c-5061de4007e9', 'volume_name': 'volume-5b31181b-dd30-4524-832c-5061de4007e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afcadd-ba53-4267-9a5a-35eea721f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afcadd-ba53-4267-9a5a-35eea721f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32054b40-c432-4b6a-adb7-8b7854596654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:21 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Volume 5b31181b-dd30-4524-832c-5061de4007e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b31181b-dd30-4524-832c-5061de4007e9', 'volume_size': 1} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b31181b-dd30-4524-832c-5061de4007e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d426fdf60d9b42edbe9942e58267ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:21Z,use_quota=True,user_id='2f4c3d4a5aee4414856217f97b55ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Creating volume 5b31181b-dd30-4524-832c-5061de4007e9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:21 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 1073741824 Nov 05 08:41:21 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:21 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 1073741824" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:22 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 Nov 05 08:41:22 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:22 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32054b40-c432-4b6a-adb7-8b7854596654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b31181b-dd30-4524-832c-5061de4007e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e0a3f1-9bb6-41b3-b24b-4239fba4e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Volume volume-5b31181b-dd30-4524-832c-5061de4007e9 (5b31181b-dd30-4524-832c-5061de4007e9): created successfully Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3e0a3f1-9bb6-41b3-b24b-4239fba4e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Flow 'volume_create_manager' (5a538797-a018-4159-ae61-8b28bb80ddd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:22 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f4901a7b-e507-440a-a152-d9fad989cce2 tempest-CinderUnicodeTest-597375463 None] Created volume successfully. Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Flow 'volume_create_manager' (ce286167-458d-4bc0-b74d-c462eab78eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7491d3-56e4-475c-b236-a02641824be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7491d3-56e4-475c-b236-a02641824be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1271107115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baf52c3-3a46-4101-9fe4-7ad5e461ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d426fdf60d9b42edbe9942e58267ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:23Z,use_quota=True,user_id='2f4c3d4a5aee4414856217f97b55ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14358248-33a0-44c8-b4e8-af8c006e8190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14358248-33a0-44c8-b4e8-af8c006e8190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5f727f-f599-40ca-b79c-c1b52bfb8470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5f727f-f599-40ca-b79c-c1b52bfb8470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3baf52c3-3a46-4101-9fe4-7ad5e461ed91', 'volume_name': 'volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3298275f-94e1-48c4-afac-469795bec093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3298275f-94e1-48c4-afac-469795bec093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc07c6f-a4cb-47ea-b88b-61a836576f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Volume 3baf52c3-3a46-4101-9fe4-7ad5e461ed91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91', 'volume_size': 1} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1271107115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baf52c3-3a46-4101-9fe4-7ad5e461ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d426fdf60d9b42edbe9942e58267ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:23Z,use_quota=True,user_id='2f4c3d4a5aee4414856217f97b55ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Creating volume 3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 1073741824 Nov 05 08:41:23 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 1073741824" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:23 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 Nov 05 08:41:23 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:23 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" returned: 0 in 0.235s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc07c6f-a4cb-47ea-b88b-61a836576f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c210a-00b5-45ac-8fa8-b8ede16bbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Volume volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 (3baf52c3-3a46-4101-9fe4-7ad5e461ed91): created successfully Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c210a-00b5-45ac-8fa8-b8ede16bbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Flow 'volume_create_manager' (ce286167-458d-4bc0-b74d-c462eab78eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e91911d7-e071-4cb4-8aeb-8457c2d984f7 tempest-CinderUnicodeTest-597375463 None] Created volume successfully. Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Creating offline snapshot d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a of volume 3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00129c-c56c-4085-b65a-71af605a6a8e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 Nov 05 08:41:24 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a 1G Nov 05 08:41:24 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:24 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a 1G" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:24 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a Nov 05 08:41:24 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a is being set with open permissions: ugo+rw Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a Nov 05 08:41:25 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info Nov 05 08:41:25 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:25 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info is being set with open permissions: ugo+rw Nov 05 08:41:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:25 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info Nov 05 08:41:25 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:25 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.info" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab5801a9-30e6-41ad-86f2-61699b089b15 tempest-CinderUnicodeTest-597375463 None] Create snapshot completed successfully Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-quobyte-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Deleting offline snapshot d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a of volume 3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] snapshot_file for this snap is: volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ceffc-1ddb-4107-9a2c-8cd23a6a884d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a Nov 05 08:41:26 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:26 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[20733a31-b5cf-42ca-8b2f-81084966bde0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:26 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 Nov 05 08:41:26 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a Nov 05 08:41:27 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" returned: 0 in 0.329s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:27 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a Nov 05 08:41:27 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:27 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91.d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" returned: 0 in 0.238s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a" released by "_delete_snapshot" :: held 1.367s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" released by "delete_snapshot" :: held 1.389s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Created reservations ['01cd59ef-2996-4705-a348-848177b1cf78', '09fa0a3d-bd1c-4967-a486-c4c2203411ca', 'be0d87fe-68a9-4abf-b296-fa76f0775dc9', '0ce2f33d-0db2-45ea-824f-5f8369a75189'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Delete snapshot completed successfully. Nov 05 08:41:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-00d20f26-706a-4959-b387-da56bb010c50 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-d5c1b9a2-e6d4-4cf5-b8b0-8f4bd26b781a-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-3baf52c3-3a46-4101-9fe4-7ad5e461ed91-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-3baf52c3-3a46-4101-9fe4-7ad5e461ed91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e3282-6938-4671-9ae9-ad747e0ae192]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 Nov 05 08:41:28 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:28 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:28 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91 Nov 05 08:41:28 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-3baf52c3-3a46-4101-9fe4-7ad5e461ed91" released by "delete_volume" :: held 0.659s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Created reservations ['bd1b853d-c485-49d4-8065-40db2f9d6bea', 'adb7b191-3b8b-439e-b3ff-7319f9f74425', 'f8fdcd0a-cacb-4ba3-8e5f-ba399117a197', '8f4cca86-b0a2-4491-b0a4-a3ac159e54e8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:29 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:29 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Deleted volume successfully. Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f4cc0e92-b519-46b2-a274-a2c56a8fece9 tempest-CinderUnicodeTest-597375463 None] Lock "cinder-3baf52c3-3a46-4101-9fe4-7ad5e461ed91-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-5b31181b-dd30-4524-832c-5061de4007e9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "cinder-5b31181b-dd30-4524-832c-5061de4007e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Acquiring lock "cinder-quobyte-5b31181b-dd30-4524-832c-5061de4007e9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-5b31181b-dd30-4524-832c-5061de4007e9" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[559916f0-ba3c-4e2d-9d97-1b82ff31bed3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:29 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 Nov 05 08:41:29 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:30 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9" returned: 0 in 0.374s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:30 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9 Nov 05 08:41:30 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:30 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5b31181b-dd30-4524-832c-5061de4007e9" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "cinder-quobyte-5b31181b-dd30-4524-832c-5061de4007e9" released by "delete_volume" :: held 0.663s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Created reservations ['195cf374-1715-4571-8dd9-ce4baf7bce60', '6b2fd983-a754-4b27-b3e0-dbb7d08d989a', '16c71516-82e2-42c7-9171-dc37341c2c29', '95745b3b-eabf-4964-af9f-38c502288613'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:30 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:30 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:30 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Deleted volume successfully. Nov 05 08:41:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d564d973-3250-4185-baa2-b7a3d32005ee tempest-CinderUnicodeTest-597375463 None] Lock "cinder-5b31181b-dd30-4524-832c-5061de4007e9-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:40 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=58,cinder:UPDATE=79,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:40 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=89,cinder:SELECT=58,cinder:INSERT=21,cinder:DELETE=9 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (4352f501-efbd-4779-8f94-4e96abeffd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273d8fa0-231a-4f22-b40a-46548c8f973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273d8fa0-231a-4f22-b40a-46548c8f973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826369124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ae9562-0eab-4d2c-b57e-41d5739fa6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35600fe5-0680-4fd8-aee0-77bc03c8d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35600fe5-0680-4fd8-aee0-77bc03c8d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c327e02-932b-44d1-b8a1-1fa8b2c8b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c327e02-932b-44d1-b8a1-1fa8b2c8b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ae9562-0eab-4d2c-b57e-41d5739fa6ba', 'volume_name': 'volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527d133e-38e0-4204-aa6d-743bd04588ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527d133e-38e0-4204-aa6d-743bd04588ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f7cafa-52a0-41ce-9b0c-33599c5161c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Volume f8ae9562-0eab-4d2c-b57e-41d5739fa6ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba', 'volume_size': 1} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826369124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ae9562-0eab-4d2c-b57e-41d5739fa6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Creating volume f8ae9562-0eab-4d2c-b57e-41d5739fa6ba {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:42 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba 1073741824 Nov 05 08:41:42 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (c6537a86-1f14-4a34-91ca-19af7168a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2aca48-a68a-4f32-8d83-bba28a31d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2aca48-a68a-4f32-8d83-bba28a31d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461597414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83e13ec-16fb-4f26-b7e0-96202da2487a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27299b7e-e19f-4de7-b5c8-824612ad9a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27299b7e-e19f-4de7-b5c8-824612ad9a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cf17a5-7674-41fa-b52e-8a068764332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cf17a5-7674-41fa-b52e-8a068764332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83e13ec-16fb-4f26-b7e0-96202da2487a', 'volume_name': 'volume-f83e13ec-16fb-4f26-b7e0-96202da2487a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453a3c8c-a8c9-421e-93ed-9b5708350629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453a3c8c-a8c9-421e-93ed-9b5708350629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ae10f8-12a7-472e-94da-f2ef98d3ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Volume f83e13ec-16fb-4f26-b7e0-96202da2487a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83e13ec-16fb-4f26-b7e0-96202da2487a', 'volume_size': 1} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:43 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba 1073741824" returned: 0 in 0.657s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:43 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba Nov 05 08:41:43 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:43 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" returned: 0 in 0.416s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461597414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83e13ec-16fb-4f26-b7e0-96202da2487a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:43Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Creating volume f83e13ec-16fb-4f26-b7e0-96202da2487a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f7cafa-52a0-41ce-9b0c-33599c5161c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a 1073741824 Nov 05 08:41:44 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182d0a07-8111-4f28-a8cd-6b525c92a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Volume volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba (f8ae9562-0eab-4d2c-b57e-41d5739fa6ba): created successfully Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182d0a07-8111-4f28-a8cd-6b525c92a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (4352f501-efbd-4779-8f94-4e96abeffd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-708a3ecf-0801-4993-a498-2a50c80dd112 tempest-CreateVolumesFromImageTest-791475598 None] Created volume successfully. Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (4c1ca3e1-f4ea-455a-957a-987b123245bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971f8ad5-598d-401b-bab3-99126e03cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971f8ad5-598d-401b-bab3-99126e03cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527235310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad58c6a4-26a7-4624-bec7-79707b6342a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1833bb81-6288-4c92-ae8d-96f6f05d2041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1833bb81-6288-4c92-ae8d-96f6f05d2041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f42c69-a9d7-4312-b2fb-be21e6c0e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f42c69-a9d7-4312-b2fb-be21e6c0e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad58c6a4-26a7-4624-bec7-79707b6342a4', 'volume_name': 'volume-ad58c6a4-26a7-4624-bec7-79707b6342a4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854fb529-2bb2-4a6e-9281-1ad7dcf788f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854fb529-2bb2-4a6e-9281-1ad7dcf788f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033e2c7-819f-440d-9e72-42c80120371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume ad58c6a4-26a7-4624-bec7-79707b6342a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad58c6a4-26a7-4624-bec7-79707b6342a4', 'volume_size': 1} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:44 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a 1073741824" returned: 0 in 0.732s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:44 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a Nov 05 08:41:44 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (85d676c3-0ce1-4fc9-a1ef-8e85f44c6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecddb24f-2b57-4e51-996e-351e2b9e0cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecddb24f-2b57-4e51-996e-351e2b9e0cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-447731347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3205f84-a338-4c91-b53e-f5e9c587f73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29f5c3b-d46c-4d36-9a3d-26239f7656c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29f5c3b-d46c-4d36-9a3d-26239f7656c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65db2f4-9941-491e-8827-e9aea68cacec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65db2f4-9941-491e-8827-e9aea68cacec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3205f84-a338-4c91-b53e-f5e9c587f73c', 'volume_name': 'volume-d3205f84-a338-4c91-b53e-f5e9c587f73c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7061cc0-117b-403a-8714-0ad83cd7372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7061cc0-117b-403a-8714-0ad83cd7372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31c71e-15bd-4dee-a8b0-04eacd53c060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Volume d3205f84-a338-4c91-b53e-f5e9c587f73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3205f84-a338-4c91-b53e-f5e9c587f73c', 'volume_size': 1} Nov 05 08:41:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (a23b47a9-8af1-4c87-8beb-932d7362fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba649e7-bb2c-4439-95b0-a8add8e72789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527235310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad58c6a4-26a7-4624-bec7-79707b6342a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:44Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume ad58c6a4-26a7-4624-bec7-79707b6342a4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba649e7-bb2c-4439-95b0-a8add8e72789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-333475607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6471fe3-5b61-46e7-b0f7-de0223cc62fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e2c4b8-ff0e-497a-a367-3595de051120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 1073741824 Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e2c4b8-ff0e-497a-a367-3595de051120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574f87-955c-4987-94d9-b38c78b605be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574f87-955c-4987-94d9-b38c78b605be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6471fe3-5b61-46e7-b0f7-de0223cc62fd', 'volume_name': 'volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47da156d-96a2-422f-951c-6a541dc90335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47da156d-96a2-422f-951c-6a541dc90335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5f9b0-d928-4599-9468-cab4ea7b2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Volume a6471fe3-5b61-46e7-b0f7-de0223cc62fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd', 'volume_size': 1} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ae10f8-12a7-472e-94da-f2ef98d3ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83e13ec-16fb-4f26-b7e0-96202da2487a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdcb51b-1f38-4aad-831b-da461a22e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Volume volume-f83e13ec-16fb-4f26-b7e0-96202da2487a (f83e13ec-16fb-4f26-b7e0-96202da2487a): created successfully Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdcb51b-1f38-4aad-831b-da461a22e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (c6537a86-1f14-4a34-91ca-19af7168a660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (0db73a58-3343-45e6-8201-1e4c9be4b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56c7290-9a21-444e-8580-3f0cb0335497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aa0db5a5-69f2-471f-9e49-9969dffc5159 tempest-CreateVolumesFromImageTest-791475598 None] Created volume successfully. Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56c7290-9a21-444e-8580-3f0cb0335497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750059429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5485f931-7078-4a66-9cff-50ed1c1f1e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c58be0-b609-4875-8cd4-cb75a46748b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c58be0-b609-4875-8cd4-cb75a46748b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73807477-311b-43b9-b01e-8387d3a08118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73807477-311b-43b9-b01e-8387d3a08118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5485f931-7078-4a66-9cff-50ed1c1f1e32', 'volume_name': 'volume-5485f931-7078-4a66-9cff-50ed1c1f1e32', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a8281-7ffa-4654-8f37-487770c2b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a8281-7ffa-4654-8f37-487770c2b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef24951f-a65b-4fa2-aedd-ad08cee1ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Volume 5485f931-7078-4a66-9cff-50ed1c1f1e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5485f931-7078-4a66-9cff-50ed1c1f1e32', 'volume_size': 1} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:45 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 1073741824" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:45 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 Nov 05 08:41:45 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:46 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4" returned: 0 in 0.312s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-447731347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3205f84-a338-4c91-b53e-f5e9c587f73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Creating volume d3205f84-a338-4c91-b53e-f5e9c587f73c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:46 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6033e2c7-819f-440d-9e72-42c80120371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad58c6a4-26a7-4624-bec7-79707b6342a4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfc84be-0631-4276-b508-41fb2ff18b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:46 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c 1073741824 Nov 05 08:41:46 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 (ad58c6a4-26a7-4624-bec7-79707b6342a4): created successfully Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cfc84be-0631-4276-b508-41fb2ff18b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (4c1ca3e1-f4ea-455a-957a-987b123245bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ab4241d2-cc82-4b5f-935b-1f8f8d777ef7 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:46 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c 1073741824" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:46 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c Nov 05 08:41:46 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-333475607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6471fe3-5b61-46e7-b0f7-de0223cc62fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Creating volume a6471fe3-5b61-46e7-b0f7-de0223cc62fd {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31c71e-15bd-4dee-a8b0-04eacd53c060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3205f84-a338-4c91-b53e-f5e9c587f73c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:47 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd 1073741824 Nov 05 08:41:47 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fce732-563c-4da3-853e-ccb6f6fcf8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Volume volume-d3205f84-a338-4c91-b53e-f5e9c587f73c (d3205f84-a338-4c91-b53e-f5e9c587f73c): created successfully Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fce732-563c-4da3-853e-ccb6f6fcf8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (85d676c3-0ce1-4fc9-a1ef-8e85f44c6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-19f36564-02f8-4bd8-8aaf-de7baeda3b77 tempest-CreateVolumesFromImageTest-791475598 None] Created volume successfully. Nov 05 08:41:47 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd 1073741824" returned: 0 in 0.631s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:47 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd Nov 05 08:41:47 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:47 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (ef93a5f4-302f-45d7-993c-937490b9c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9403c3-4cca-447d-b2ff-32df1fd058f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9403c3-4cca-447d-b2ff-32df1fd058f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219778372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072282b3-b404-4c0c-ab49-2a986925194a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:48Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a314e61-d3c2-4ba7-89b6-a4106fa6e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a314e61-d3c2-4ba7-89b6-a4106fa6e272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21628da-9294-4e24-84dd-bc422564b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21628da-9294-4e24-84dd-bc422564b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '072282b3-b404-4c0c-ab49-2a986925194a', 'volume_name': 'volume-072282b3-b404-4c0c-ab49-2a986925194a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df58e65-f90e-4772-b886-0da270dce132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df58e65-f90e-4772-b886-0da270dce132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df318eb-9acf-4b1d-a196-fe843e7aef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume 072282b3-b404-4c0c-ab49-2a986925194a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-072282b3-b404-4c0c-ab49-2a986925194a', 'volume_size': 1} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" returned: 0 in 0.365s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750059429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5485f931-7078-4a66-9cff-50ed1c1f1e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2677bdda00f4430a8a055f0f3c1f5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:45Z,use_quota=True,user_id='840d21400fb847c7a505b4fdce37b7d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Creating volume 5485f931-7078-4a66-9cff-50ed1c1f1e32 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:48 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5f9b0-d928-4599-9468-cab4ea7b2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fa6f5a-6816-4176-95a9-4d95f2ff3be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 1073741824 Nov 05 08:41:48 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Volume volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd (a6471fe3-5b61-46e7-b0f7-de0223cc62fd): created successfully Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fa6f5a-6816-4176-95a9-4d95f2ff3be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (a23b47a9-8af1-4c87-8beb-932d7362fab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8446d559-2c32-4ab3-8d22-aa27d40fac85 tempest-CreateVolumesFromImageTest-791475598 None] Created volume successfully. Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:48 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (398abdbc-8881-4133-b844-5788ec98ff2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ee372c-397e-4d22-9103-16277f7106fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 1073741824" returned: 0 in 0.755s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ee372c-397e-4d22-9103-16277f7106fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029170658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5096c9-fe52-41ca-a243-60db81ef676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f187a5-41c2-4b0e-8538-1b2c8cdb8b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f187a5-41c2-4b0e-8538-1b2c8cdb8b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0345c22-daeb-4a6a-9a2f-a7c31af18224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0345c22-daeb-4a6a-9a2f-a7c31af18224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5096c9-fe52-41ca-a243-60db81ef676f', 'volume_name': 'volume-df5096c9-fe52-41ca-a243-60db81ef676f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9223fbc5-20cf-4cd5-900f-887e5d3e1c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9223fbc5-20cf-4cd5-900f-887e5d3e1c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2570fae-1566-4889-b3f1-8a5ee10a4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume df5096c9-fe52-41ca-a243-60db81ef676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5096c9-fe52-41ca-a243-60db81ef676f', 'volume_size': 1} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Flow 'volume_create_manager' (3904c6f0-9272-4c99-a2fa-20106891f7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ffd3c4-3424-48af-8ca7-c027b561b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ffd3c4-3424-48af-8ca7-c027b561b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6761686-b05f-4b39-a945-df70a3105c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a033d62f224f259231ab8eaf7df2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='07438a4ff00742fda3c1250ebebc7015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b57d133-5ad8-47e1-a571-b1423e8ec8e0),volume_type_id=4b57d133-5ad8-47e1-a571-b1423e8ec8e0)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e61c41-988d-493c-b0ba-9c4f2176a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e61c41-988d-493c-b0ba-9c4f2176a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e7a55f-1c7c-479e-b897-d863e328f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 Nov 05 08:41:49 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (80dd4555-e2ac-4b01-a963-c9fe35c2b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b42f775-7435-47a3-9031-3cfdd098dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b42f775-7435-47a3-9031-3cfdd098dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252635292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd5dfca-8643-4be6-acc3-ea77bceeee2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d3b649-d118-4991-a98d-81679ff90628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d3b649-d118-4991-a98d-81679ff90628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ac0bc-199e-4102-973c-24e5f1eb9d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ac0bc-199e-4102-973c-24e5f1eb9d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd5dfca-8643-4be6-acc3-ea77bceeee2c', 'volume_name': 'volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e2385-21b5-4ac4-884d-539bf477dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e2385-21b5-4ac4-884d-539bf477dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20e7b59-3d37-40f2-81b6-991e6a7b07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume 4cd5dfca-8643-4be6-acc3-ea77bceeee2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c', 'volume_size': 1} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32" returned: 0 in 0.342s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219778372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072282b3-b404-4c0c-ab49-2a986925194a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:48Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume 072282b3-b404-4c0c-ab49-2a986925194a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:49 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:49 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a 1073741824 Nov 05 08:41:49 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef24951f-a65b-4fa2-aedd-ad08cee1ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5485f931-7078-4a66-9cff-50ed1c1f1e32', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdda0c6-a44a-46bf-91bd-378ae5b1e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Volume volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 (5485f931-7078-4a66-9cff-50ed1c1f1e32): created successfully Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdda0c6-a44a-46bf-91bd-378ae5b1e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Flow 'volume_create_manager' (0db73a58-3343-45e6-8201-1e4c9be4b66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-28793602-e96e-45da-9dc6-f7a9eee4d447 tempest-CreateVolumesFromImageTest-791475598 None] Created volume successfully. Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (d343707f-b04a-41ee-abd6-845557d33f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b419c70-6711-4044-a5ea-3deea73dcbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-5485f931-7078-4a66-9cff-50ed1c1f1e32-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b419c70-6711-4044-a5ea-3deea73dcbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066930744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eb7a83-fdd1-4da8-85e8-a6952ddbab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:50Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec973e-0a2e-435d-9c6b-61884d617954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec973e-0a2e-435d-9c6b-61884d617954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67d32f5-61fb-4c5b-afac-d86eae4cf936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67d32f5-61fb-4c5b-afac-d86eae4cf936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11eb7a83-fdd1-4da8-85e8-a6952ddbab7a', 'volume_name': 'volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12e1fdf-d34c-41cf-af55-3993d0c38893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12e1fdf-d34c-41cf-af55-3993d0c38893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f9c317-c55f-4fd6-9f2f-52c96f27e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume 11eb7a83-fdd1-4da8-85e8-a6952ddbab7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a', 'volume_size': 1} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-5485f931-7078-4a66-9cff-50ed1c1f1e32-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:49 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-quobyte-5485f931-7078-4a66-9cff-50ed1c1f1e32" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-5485f931-7078-4a66-9cff-50ed1c1f1e32" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15dd5a0-4166-4bbe-b879-c3fa5f0789f4]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 Nov 05 08:41:50 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e7a55f-1c7c-479e-b897-d863e328f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6761686-b05f-4b39-a945-df70a3105c2b', 'volume_name': 'volume-f6761686-b05f-4b39-a945-df70a3105c2b', 'volume_size': 1, 'image_id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce137739b10e20e60eb5f6878a5c4098', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9a033d62f224f259231ab8eaf7df2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19bb1a34d617102071bec800aedb5b467acd65528dc92fc3c5d23635fc86b482dd667a5ba10be36752feadf15ef507883b034844a11ccc7f4fe1cf5e2d539271', 'id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958bca4b-623f-45ab-b6d1-fd1daf1458eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958bca4b-623f-45ab-b6d1-fd1daf1458eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9b9325-ade9-43e7-8f70-95aa197e0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Volume f6761686-b05f-4b39-a945-df70a3105c2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6761686-b05f-4b39-a945-df70a3105c2b', 'volume_size': 1, 'image_id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce137739b10e20e60eb5f6878a5c4098', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9a033d62f224f259231ab8eaf7df2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19bb1a34d617102071bec800aedb5b467acd65528dc92fc3c5d23635fc86b482dd667a5ba10be36752feadf15ef507883b034844a11ccc7f4fe1cf5e2d539271', 'id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Trying to clone f6761686-b05f-4b39-a945-df70a3105c2b from image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c at location (None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a 1073741824" returned: 0 in 0.853s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:50 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a Nov 05 08:41:50 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (b53c2891-2d55-43e3-9888-6e66341fac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9474f75b-c9a8-4eb2-90e1-b712069ff8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9474f75b-c9a8-4eb2-90e1-b712069ff8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237792956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb6496-faf0-4c2a-be17-efac53821c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:50Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eea320-8d3f-4708-b8cf-4213d5b3f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9eea320-8d3f-4708-b8cf-4213d5b3f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455425f2-d176-4b9b-9a9b-5be79c6ee271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455425f2-d176-4b9b-9a9b-5be79c6ee271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcb6496-faf0-4c2a-be17-efac53821c82', 'volume_name': 'volume-4dcb6496-faf0-4c2a-be17-efac53821c82', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6de8e6-c48f-4d1a-957e-16aaf54123e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6de8e6-c48f-4d1a-957e-16aaf54123e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47faf45c-1c0c-4291-98fb-fa66cd92c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume 4dcb6496-faf0-4c2a-be17-efac53821c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcb6496-faf0-4c2a-be17-efac53821c82', 'volume_size': 1} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d355030-8de5-4c2a-a89f-7e600cb752b8]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32" returned: 0 in 0.558s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32 Nov 05 08:41:50 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:50 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029170658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5096c9-fe52-41ca-a243-60db81ef676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume df5096c9-fe52-41ca-a243-60db81ef676f {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df318eb-9acf-4b1d-a196-fe843e7aef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072282b3-b404-4c0c-ab49-2a986925194a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f 1073741824 Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc3ac1-d991-49d1-ac4b-b7acaba963ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:50 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-072282b3-b404-4c0c-ab49-2a986925194a (072282b3-b404-4c0c-ab49-2a986925194a): created successfully Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc3ac1-d991-49d1-ac4b-b7acaba963ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (ef93a5f4-302f-45d7-993c-937490b9c30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e8676ac9-6b5a-4025-8955-8eabe366742d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:41:51 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (5a74f1da-d77a-4df1-a3f5-823ba2eb81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601b768a-a0c0-4f97-b09e-83ec22ab98ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5485f931-7078-4a66-9cff-50ed1c1f1e32" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601b768a-a0c0-4f97-b09e-83ec22ab98ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772319095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d69eab1-2d85-42d4-ba95-fece2da965ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:51Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8043520-c16b-41aa-8d24-4ce721c95ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8043520-c16b-41aa-8d24-4ce721c95ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21194e81-8bd7-4eff-9327-00d9114e9cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21194e81-8bd7-4eff-9327-00d9114e9cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d69eab1-2d85-42d4-ba95-fece2da965ee', 'volume_name': 'volume-9d69eab1-2d85-42d4-ba95-fece2da965ee', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c026a1d2-b090-4399-b33d-ad3695cc11ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c026a1d2-b090-4399-b33d-ad3695cc11ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a2c9b-c5f1-4e82-922c-108e309d294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Volume 9d69eab1-2d85-42d4-ba95-fece2da965ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d69eab1-2d85-42d4-ba95-fece2da965ee', 'volume_size': 1} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-5485f931-7078-4a66-9cff-50ed1c1f1e32" released by "delete_volume" :: held 1.103s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Created reservations ['6764adec-4b9c-4056-9ae1-2e6c3292bbcd', '0a734515-9ad5-403d-8394-51e3a380ddf9', 'a86ded5d-7081-47d7-9399-a6eb3314d4ea', '2ba9be48-b760-492f-871d-07febeb4e3b9'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:51 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:51 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:51 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f 1073741824" returned: 0 in 0.581s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f Nov 05 08:41:51 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Temporary image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c is fetched for user 07438a4ff00742fda3c1250ebebc7015. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:41:51 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Deleted volume successfully. Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a5742e0b-cd4b-4271-aaaf-022edf1deba9 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-5485f931-7078-4a66-9cff-50ed1c1f1e32-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9318390-ae68-478f-a4df-31771772af8e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1252635292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd5dfca-8643-4be6-acc3-ea77bceeee2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume 4cd5dfca-8643-4be6-acc3-ea77bceeee2c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:51 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:51 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c 1073741824 Nov 05 08:41:51 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2570fae-1566-4889-b3f1-8a5ee10a4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5096c9-fe52-41ca-a243-60db81ef676f', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6e266e-d18b-45c6-afba-abc91be5acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:51 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-df5096c9-fe52-41ca-a243-60db81ef676f (df5096c9-fe52-41ca-a243-60db81ef676f): created successfully Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6e266e-d18b-45c6-afba-abc91be5acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (398abdbc-8881-4133-b844-5788ec98ff2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:51 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:51 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82eddc60-64cf-4c82-974b-e938fd73952d tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:51 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:51 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:52 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-a6471fe3-5b61-46e7-b0f7-de0223cc62fd-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-a6471fe3-5b61-46e7-b0f7-de0223cc62fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:52 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c 1073741824" returned: 0 in 0.499s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-quobyte-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:52 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c Nov 05 08:41:52 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[706474ed-60a8-4dbc-84b7-33e5e417cac2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:52 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd Nov 05 08:41:52 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1066930744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11eb7a83-fdd1-4da8-85e8-a6952ddbab7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:50Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume 11eb7a83-fdd1-4da8-85e8-a6952ddbab7a {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:52 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20e7b59-3d37-40f2-81b6-991e6a7b07f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:52 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a 1073741824 Nov 05 08:41:52 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30702ce9-cbb4-426c-8fff-3647ed3c1e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c (4cd5dfca-8643-4be6-acc3-ea77bceeee2c): created successfully Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30702ce9-cbb4-426c-8fff-3647ed3c1e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (80dd4555-e2ac-4b01-a963-c9fe35c2b91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-64579417-11e1-4d6f-9d67-1b577384310f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:52 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:52 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd Nov 05 08:41:52 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:52 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" returned: 0 in 0.273s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-a6471fe3-5b61-46e7-b0f7-de0223cc62fd" released by "delete_volume" :: held 0.698s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Created reservations ['9c4bf1bb-418b-4e2f-99bb-6c5229c8b293', 'af35d9fb-0fea-4ebb-b0f8-aff2b52c8b94', '1a6aa54a-df63-45b4-a8a3-39a0a88d5323', '9c5640b3-431f-4c89-bf86-b5e9bb49d277'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:52 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a 1073741824" returned: 0 in 0.502s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a Nov 05 08:41:53 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:53 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237792956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb6496-faf0-4c2a-be17-efac53821c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='268a4066de5b49fa9283d24754b98eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:50Z,use_quota=True,user_id='bb000175add5403894eff3527a8f08ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Creating volume 4dcb6496-faf0-4c2a-be17-efac53821c82 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:53 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-d3205f84-a338-4c91-b53e-f5e9c587f73c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:53 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:53 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 1073741824 Nov 05 08:41:53 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f9c317-c55f-4fd6-9f2f-52c96f27e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bae3471-27f3-40cf-8703-1a8692facc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Deleted volume successfully. Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-d3205f84-a338-4c91-b53e-f5e9c587f73c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a (11eb7a83-fdd1-4da8-85e8-a6952ddbab7a): created successfully Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bae3471-27f3-40cf-8703-1a8692facc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (d343707f-b04a-41ee-abd6-845557d33f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1dc5927b-ac7e-41d2-8322-bf6a4cece6b5 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-a6471fe3-5b61-46e7-b0f7-de0223cc62fd-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b06a0c5e-eb92-4811-8f97-e96467c82cc0 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-quobyte-d3205f84-a338-4c91-b53e-f5e9c587f73c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-d3205f84-a338-4c91-b53e-f5e9c587f73c" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b6222-1047-4d29-a937-377d662d10bf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c Nov 05 08:41:53 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 1073741824" returned: 0 in 0.536s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 Nov 05 08:41:53 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:53 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:53 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c Nov 05 08:41:53 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.041s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772319095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d69eab1-2d85-42d4-ba95-fece2da965ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:51Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Creating volume 9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47faf45c-1c0c-4291-98fb-fa66cd92c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcb6496-faf0-4c2a-be17-efac53821c82', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:54 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee 1073741824 Nov 05 08:41:54 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feae16d-a970-4223-bab0-9caf1c7d1029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Volume volume-4dcb6496-faf0-4c2a-be17-efac53821c82 (4dcb6496-faf0-4c2a-be17-efac53821c82): created successfully Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feae16d-a970-4223-bab0-9caf1c7d1029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:54 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Flow 'volume_create_manager' (b53c2891-2d55-43e3-9888-6e66341fac88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d3205f84-a338-4c91-b53e-f5e9c587f73c" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-d3205f84-a338-4c91-b53e-f5e9c587f73c" released by "delete_volume" :: held 0.771s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-75e5b045-d615-4944-8faf-9c644f5abf3f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created volume successfully. Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Created reservations ['123607d3-6118-4489-9586-256bc052fc0c', '502b3902-8ea0-48f1-b238-1f072a658a66', '191bf4bd-e33b-46e2-8d80-f79e8172bbd1', '35dec04e-490d-4b93-bfe6-05f6fa3b749d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:54 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-f83e13ec-16fb-4f26-b7e0-96202da2487a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-f83e13ec-16fb-4f26-b7e0-96202da2487a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-quobyte-f83e13ec-16fb-4f26-b7e0-96202da2487a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-f83e13ec-16fb-4f26-b7e0-96202da2487a" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[357092ec-1aa2-45ca-b22a-454d7742c285]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:54 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee 1073741824" returned: 0 in 0.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Deleted volume successfully. Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:54 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a Nov 05 08:41:54 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cc587c6c-6cd2-4795-8d88-cfd036e5b13f tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-d3205f84-a338-4c91-b53e-f5e9c587f73c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:54 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee Nov 05 08:41:54 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-4dcb6496-faf0-4c2a-be17-efac53821c82-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-4dcb6496-faf0-4c2a-be17-efac53821c82-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-4dcb6496-faf0-4c2a-be17-efac53821c82" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-4dcb6496-faf0-4c2a-be17-efac53821c82" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13eb743-bbd4-44d2-8115-0e680d46e71c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee" returned: 0 in 0.296s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.706s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6761686-b05f-4b39-a945-df70a3105c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a033d62f224f259231ab8eaf7df2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:41:49Z,use_quota=True,user_id='07438a4ff00742fda3c1250ebebc7015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b57d133-5ad8-47e1-a571-b1423e8ec8e0),volume_type_id=4b57d133-5ad8-47e1-a571-b1423e8ec8e0)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Creating volume f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:55 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:41:55 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1073741824 Nov 05 08:41:55 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a2c9b-c5f1-4e82-922c-108e309d294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d69eab1-2d85-42d4-ba95-fece2da965ee', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d21ce37-f9c4-4294-89f6-5fcae0859695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:55 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a Nov 05 08:41:55 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Volume volume-9d69eab1-2d85-42d4-ba95-fece2da965ee (9d69eab1-2d85-42d4-ba95-fece2da965ee): created successfully Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d21ce37-f9c4-4294-89f6-5fcae0859695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (5a74f1da-d77a-4df1-a3f5-823ba2eb81fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:55 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 Nov 05 08:41:55 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9237a06d-83d9-4540-a025-fd4cd0ca006a tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:41:55 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f83e13ec-16fb-4f26-b7e0-96202da2487a" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-f83e13ec-16fb-4f26-b7e0-96202da2487a" released by "delete_volume" :: held 0.785s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Created reservations ['e81f372e-2133-481c-9cde-3674f7f6f1b9', '18823d6c-ac86-401d-9f79-4afd247a0375', '50344eae-cafa-4171-a667-82bf9a9cece4', 'f60f3238-92bf-433e-b861-c08c05bccd7d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:55 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82" returned: 0 in 0.458s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82 Nov 05 08:41:55 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1073741824" returned: 0 in 0.500s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:55 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b Nov 05 08:41:55 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dcb6496-faf0-4c2a-be17-efac53821c82" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-4dcb6496-faf0-4c2a-be17-efac53821c82" released by "delete_volume" :: held 0.802s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "cinder-quobyte-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Deleted volume successfully. Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2bc1fd01-16b6-4dea-a596-026d080f7eed tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-f83e13ec-16fb-4f26-b7e0-96202da2487a-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[de242783-fe76-4443-aa12-dde9628960c3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:55 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['a99a2505-7168-48e6-a2ad-16cf628754e8', 'f434e851-c45b-4ffb-9094-6b5b62431b9f', 'fe3297fa-36e0-404c-ac52-697230f2e373', '53abd4b7-c002-4de8-9da5-72adabcbd00f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b" returned: 0 in 0.332s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Attempting download of 2abdbd8e-eb6b-45db-bc7e-7e23efee102c ((None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}])) to volume f6761686-b05f-4b39-a945-df70a3105c2b. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb51198-6d0a-4591-b48d-595b123d35a7]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba Nov 05 08:41:56 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:56 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:56 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l Nov 05 08:41:56 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4de55-a1e4-4f0c-92f7-135b83809999]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.378s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:41:56 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d5ae79dc-abdf-428e-bf91-fc358e0b052a tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-4dcb6496-faf0-4c2a-be17-efac53821c82-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a Nov 05 08:41:56 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba Nov 05 08:41:56 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l Nov 05 08:41:56 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a Nov 05 08:41:56 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-quobyte-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba" released by "delete_volume" :: held 0.967s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Creating offline snapshot 4c3d40ea-8470-4b0c-a811-0994fe7c2341 of volume 9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:41:56 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770f0bb-8d2e-444c-b802-7ffa4dacf40f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l" returned: 1 in 0.490s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_e8ooza7l' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfb080-5e5f-4a45-83bf-36c312b10d58]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Created reservations ['0b180dc2-0851-4711-8079-52448a9fc432', '9819c3ec-6e60-4a06-8602-a229df22986f', '0dc87135-f47b-4db3-bdd7-7eedf44c0f0b', '738038a4-a0f7-40da-8102-5f2b0562f4a8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:57 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee Nov 05 08:41:57 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:57 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a" released by "delete_volume" :: held 0.858s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:57 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['e8ce0004-9818-486a-b5fb-1cfdc948682e', 'b97ce6f9-2a2d-4754-929a-6289d0686c42', '6b686841-727f-47cc-87eb-36d6dace5423', '95402ea1-5bc8-42be-817f-a329569ea125'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:57 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee" returned: 0 in 0.506s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-4cd5dfca-8643-4be6-acc3-ea77bceeee2c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:57 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 1G Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Deleted volume successfully. Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-4cd5dfca-8643-4be6-acc3-ea77bceeee2c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bfaaf0a4-5f19-4e0d-ae9c-472ce7a4c402 tempest-CreateVolumesFromImageTest-791475598 None] Lock "cinder-f8ae9562-0eab-4d2c-b57e-41d5739fa6ba-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD Nov 05 08:41:57 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:57 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.351s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6419354-47b5-40c5-b844-78a132d55705]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2f6eeef1-9356-40c7-9675-403293b5e9cc tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-11eb7a83-fdd1-4da8-85e8-a6952ddbab7a-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:57 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c Nov 05 08:41:57 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] 2abdbd8e-eb6b-45db-bc7e-7e23efee102c was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:57 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b Nov 05 08:41:57 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:57 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 1G" returned: 0 in 0.573s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d69eab1-2d85-42d4-ba95-fece2da965ee -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d69eab1-2d85-42d4-ba95-fece2da965ee -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 Nov 05 08:41:58 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c Nov 05 08:41:58 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d69eab1-2d85-42d4-ba95-fece2da965ee -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 is being set with open permissions: ugo+rw Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 Nov 05 08:41:58 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" returned: 0 in 0.345s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-4cd5dfca-8643-4be6-acc3-ea77bceeee2c" released by "delete_volume" :: held 0.844s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b" returned: 0 in 0.616s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2abdbd8e-eb6b-45db-bc7e-7e23efee102c_sj_jwgj7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:41:58 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1G Nov 05 08:41:58 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['4088e8af-3012-4e60-821d-cfe236faf08e', '62b1518f-063d-4dd7-b7c5-a944268e548b', 'ca98e1f0-4b30-4bd2-8206-d1e8c6bdeb89', '8f20215e-9a85-49d5-9c82-353f2633b586'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:41:58 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-df5096c9-fe52-41ca-a243-60db81ef676f-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:58 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info Nov 05 08:41:58 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-df5096c9-fe52-41ca-a243-60db81ef676f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-df5096c9-fe52-41ca-a243-60db81ef676f" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-df5096c9-fe52-41ca-a243-60db81ef676f" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[04524d56-0260-4404-a12e-5e879ab6a567]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:58 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b 1G" returned: 0 in 0.510s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Downloaded image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c ((None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}])) to volume f6761686-b05f-4b39-a945-df70a3105c2b successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Temporary image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c for user 07438a4ff00742fda3c1250ebebc7015 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Marking volume f6761686-b05f-4b39-a945-df70a3105c2b as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Copying metadata from image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c to f6761686-b05f-4b39-a945-df70a3105c2b. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:41:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Creating volume glance metadata for volume f6761686-b05f-4b39-a945-df70a3105c2b backed by image 2abdbd8e-eb6b-45db-bc7e-7e23efee102c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ce137739b10e20e60eb5f6878a5c4098', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:41:58 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.409s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:41:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d10b3293-a0cb-45d4-9cec-1c3407e5e39f tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-4cd5dfca-8643-4be6-acc3-ea77bceeee2c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:59 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f Nov 05 08:41:59 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9b9325-ade9-43e7-8f70-95aa197e0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6761686-b05f-4b39-a945-df70a3105c2b', 'volume_size': 1, 'image_id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce137739b10e20e60eb5f6878a5c4098', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9a033d62f224f259231ab8eaf7df2a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19bb1a34d617102071bec800aedb5b467acd65528dc92fc3c5d23635fc86b482dd667a5ba10be36752feadf15ef507883b034844a11ccc7f4fe1cf5e2d539271', 'id': '2abdbd8e-eb6b-45db-bc7e-7e23efee102c', 'created_at': datetime.datetime(2026, 11, 5, 7, 41, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 41, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2abdbd8e-eb6b-45db-bc7e-7e23efee102c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb3024c-0bc1-4da0-9a72-5f0ec1b62cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:41:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Volume volume-f6761686-b05f-4b39-a945-df70a3105c2b (f6761686-b05f-4b39-a945-df70a3105c2b): created successfully Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb3024c-0bc1-4da0-9a72-5f0ec1b62cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Flow 'volume_create_manager' (3904c6f0-9272-4c99-a2fa-20106891f7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:41:59 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info is being set with open permissions: ugo+rw Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-691ea488-5317-4ec6-9f10-c84e43c34965 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Created volume successfully. Nov 05 08:41:59 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info Nov 05 08:41:59 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f" returned: 0 in 0.492s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f Nov 05 08:41:59 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.info" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:41:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-851117f5-b9f4-44b9-b367-3f559d652409 tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Acquiring lock "cinder-f6761686-b05f-4b39-a945-df70a3105c2b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "cinder-f6761686-b05f-4b39-a945-df70a3105c2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Acquiring lock "cinder-quobyte-f6761686-b05f-4b39-a945-df70a3105c2b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "cinder-quobyte-f6761686-b05f-4b39-a945-df70a3105c2b" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[88edcf32-6023-4de4-a1a6-1f38331e33bc]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:41:59 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-df5096c9-fe52-41ca-a243-60db81ef676f" returned: 0 in 0.325s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-df5096c9-fe52-41ca-a243-60db81ef676f" released by "delete_volume" :: held 0.896s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:41:59 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['269b59af-74ed-41bc-9b95-15cdcb63bab6', 'b63c0e46-2712-4bdb-8a77-fce219caccb5', 'a064eb75-368c-4b4a-8947-1bdc344aa7d7', 'd45afade-916b-455a-915b-0f8487efebbf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:41:59 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b Nov 05 08:41:59 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:41:59 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-4c3d40ea-8470-4b0c-a811-0994fe7c2341-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-072282b3-b404-4c0c-ab49-2a986925194a-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-072282b3-b404-4c0c-ab49-2a986925194a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-4c3d40ea-8470-4b0c-a811-0994fe7c2341-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-4c3d40ea-8470-4b0c-a811-0994fe7c2341" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:41:59 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-4c3d40ea-8470-4b0c-a811-0994fe7c2341" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot 4c3d40ea-8470-4b0c-a811-0994fe7c2341 of volume 9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-072282b3-b404-4c0c-ab49-2a986925194a" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b8920-4234-455f-af4b-8c0d0f54aa95]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-072282b3-b404-4c0c-ab49-2a986925194a" acquired by "delete_volume" :: waited 0.040s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[79637222-0ff9-4b53-831b-79339d5654eb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b" returned: 0 in 0.633s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.493s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:00 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b Nov 05 08:42:00 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 Nov 05 08:42:00 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-edfd09e5-b475-4662-b9d7-41694ddc5c51 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-df5096c9-fe52-41ca-a243-60db81ef676f-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:00 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a Nov 05 08:42:00 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f6761686-b05f-4b39-a945-df70a3105c2b" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "cinder-quobyte-f6761686-b05f-4b39-a945-df70a3105c2b" released by "delete_volume" :: held 1.041s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Created reservations ['ae2da845-fc6e-4342-b744-29dfb21c7ea8', '8351d2e9-ee4e-488c-8d23-47b9d40b0fb9', '7cc58ac7-eda9-4b17-bfe2-8b8faeddd566', 'dbbf81f5-d141-42e9-9cda-4d8231ddcd72'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:00 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341" returned: 0 in 0.569s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d69eab1-2d85-42d4-ba95-fece2da965ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f54fdf-3c6c-4f8f-98ef-2988a1079c09]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a" returned: 0 in 0.575s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:00 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a Nov 05 08:42:00 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:00 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:00 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee Nov 05 08:42:00 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-072282b3-b404-4c0c-ab49-2a986925194a" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-072282b3-b404-4c0c-ab49-2a986925194a" released by "delete_volume" :: held 0.926s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:01 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Deleted volume successfully. Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['4d82bf33-504b-4860-99e1-d7561dc02732', '835a0fe6-78ae-4d8a-95da-452ae9cbb20b', '3d724012-2735-4d9a-bf0b-081bd57be433', '43a15d77-0049-41f9-a412-fd7b0a04b0cf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-98590719-26f9-402f-9a21-9429fc92f106 tempest-VolumeAndVolumeTypeFromImageTest-1285026437 None] Lock "cinder-f6761686-b05f-4b39-a945-df70a3105c2b-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:01 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee" returned: 0 in 0.451s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:01 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 Nov 05 08:42:01 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:01 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:01 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:01 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5799a38d-4f95-4abc-8a57-7ab390a8bd17 tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-072282b3-b404-4c0c-ab49-2a986925194a-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:01 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341" returned: 0 in 0.374s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:01 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341 Nov 05 08:42:01 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:01 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee.4c3d40ea-8470-4b0c-a811-0994fe7c2341" returned: 0 in 0.284s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-4c3d40ea-8470-4b0c-a811-0994fe7c2341" released by "_delete_snapshot" :: held 1.845s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" released by "delete_snapshot" :: held 1.894s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Created reservations ['fd2e75b3-f904-4577-8b68-6c350f8325a2', '13eb052b-04b0-4750-8a86-35241836436b', '230b653e-c456-4f22-bd56-60ecef946800', '69877a6c-4923-4c33-8722-c6e0b5b7577b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8ee9e754-c34e-4976-beec-6dfc4b6a4aa2 tempest-ProjectMemberTests-78095360 None] Lock "cinder-4c3d40ea-8470-4b0c-a811-0994fe7c2341-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Flow 'volume_create_manager' (940750bf-6d6e-4b7b-ba1d-8514349b3815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51472444-c7c2-462e-91a0-9298ef6f4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51472444-c7c2-462e-91a0-9298ef6f4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-614859242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b5f249-d670-4f4c-99ad-0d45663bde9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71e12fafa7498d8ab0ed1abb5027fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:02Z,use_quota=True,user_id='bb46f7ad0f064bfca05ff2eec49bd530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9a655-4e22-4ebd-81d3-35cfbf1e51fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca9a655-4e22-4ebd-81d3-35cfbf1e51fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9e3c3-77c0-4658-baaf-dc2c172b3c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a9e3c3-77c0-4658-baaf-dc2c172b3c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b5f249-d670-4f4c-99ad-0d45663bde9c', 'volume_name': 'volume-27b5f249-d670-4f4c-99ad-0d45663bde9c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa3195e-8356-4264-a29e-a5496b58257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa3195e-8356-4264-a29e-a5496b58257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6175bbce-5b3c-4d93-aa18-717c9a5d1e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Volume 27b5f249-d670-4f4c-99ad-0d45663bde9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b5f249-d670-4f4c-99ad-0d45663bde9c', 'volume_size': 1} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-614859242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b5f249-d670-4f4c-99ad-0d45663bde9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71e12fafa7498d8ab0ed1abb5027fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:02Z,use_quota=True,user_id='bb46f7ad0f064bfca05ff2eec49bd530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Creating volume 27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-9d69eab1-2d85-42d4-ba95-fece2da965ee-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-ad58c6a4-26a7-4624-bec7-79707b6342a4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:02 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c 1073741824 Nov 05 08:42:02 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "cinder-9d69eab1-2d85-42d4-ba95-fece2da965ee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-ad58c6a4-26a7-4624-bec7-79707b6342a4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "cinder-quobyte-ad58c6a4-26a7-4624-bec7-79707b6342a4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[376bf6e2-315b-476f-a940-41289bc4439d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-ad58c6a4-26a7-4624-bec7-79707b6342a4" acquired by "delete_volume" :: waited 0.069s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[61422278-ab0a-4559-bc57-dcfb799d91e2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee Nov 05 08:42:02 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 Nov 05 08:42:02 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:02 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c 1073741824" returned: 0 in 0.513s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:02 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:02 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee" returned: 0 in 0.444s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee Nov 05 08:42:03 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4" returned: 0 in 0.468s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4 Nov 05 08:42:03 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6175bbce-5b3c-4d93-aa18-717c9a5d1e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b5f249-d670-4f4c-99ad-0d45663bde9c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7028fec2-b6c7-4f46-a96b-59ef85bdb6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Volume volume-27b5f249-d670-4f4c-99ad-0d45663bde9c (27b5f249-d670-4f4c-99ad-0d45663bde9c): created successfully Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7028fec2-b6c7-4f46-a96b-59ef85bdb6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:03 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Flow 'volume_create_manager' (940750bf-6d6e-4b7b-ba1d-8514349b3815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9d69eab1-2d85-42d4-ba95-fece2da965ee" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9d69eab1-2d85-42d4-ba95-fece2da965ee" released by "delete_volume" :: held 0.900s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4f41f228-6586-41e0-973f-63c0b40de0e2 tempest-VolumeDependencyTests-390498562 None] Created volume successfully. Nov 05 08:42:03 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-ad58c6a4-26a7-4624-bec7-79707b6342a4" returned: 0 in 0.355s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-quobyte-ad58c6a4-26a7-4624-bec7-79707b6342a4" released by "delete_volume" :: held 0.896s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Created reservations ['2fc2b142-be84-4932-843a-671822293cf2', 'b84078d2-73ec-4491-9e35-b69de022e03e', '3aba3de5-31f1-41cf-80d6-44d213f5af61', 'f092f3c9-f334-4142-9bc8-6b03df43407b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Created reservations ['ebe413ba-af92-4b5b-bc5d-d88a6339b47e', '2ca64e38-76ee-4daa-94d1-9c712d03f88c', '411dbfd6-3914-4837-bc48-cd303ed31d75', 'd66ef24c-4fe6-4220-ade5-c0e759cac0d5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:03 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:03 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:03 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:03 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:42:03 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e4fc4d3c-2888-4c8d-912e-cd0e8ca5f383 tempest-ProjectMemberTests-78095360 None] Lock "cinder-9d69eab1-2d85-42d4-ba95-fece2da965ee-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:03 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Deleted volume successfully. Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a6161baf-6cfd-484d-9357-b8209799f7ad tempest-CreateVolumesFromSourceVolumeTest-749817780 None] Lock "cinder-ad58c6a4-26a7-4624-bec7-79707b6342a4-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Creating offline snapshot 4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 of volume 27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb9a7e6-097d-4d7b-9a4a-dd6846a6815a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:04 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:04 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 1G Nov 05 08:42:05 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (80740b06-9e0a-42b7-990b-9a69f91e7324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad420a-0766-47fb-bb45-db4e0a521770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad420a-0766-47fb-bb45-db4e0a521770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840886573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d672269b-b028-4298-a256-2b981c27f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:05Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d69a3ff-7cd1-4e62-a271-788208a64a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d69a3ff-7cd1-4e62-a271-788208a64a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3c4e34-7677-4b08-9687-274b87d8c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3c4e34-7677-4b08-9687-274b87d8c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd672269b-b028-4298-a256-2b981c27f06b', 'volume_name': 'volume-d672269b-b028-4298-a256-2b981c27f06b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082bfce9-0d5c-44d4-aaba-49fed25a8bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082bfce9-0d5c-44d4-aaba-49fed25a8bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058cb447-9fda-4cd5-a3a9-1c66e07d5fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:05 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Volume d672269b-b028-4298-a256-2b981c27f06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d672269b-b028-4298-a256-2b981c27f06b', 'volume_size': 1} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:05 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 1G" returned: 0 in 0.505s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b5f249-d670-4f4c-99ad-0d45663bde9c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b5f249-d670-4f4c-99ad-0d45663bde9c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:05 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:05 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b5f249-d670-4f4c-99ad-0d45663bde9c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.339s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 is being set with open permissions: ugo+rw Nov 05 08:42:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:05 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:05 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:06 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.294s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:06 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info Nov 05 08:42:06 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:06 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:06 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info is being set with open permissions: ugo+rw Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:06 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info Nov 05 08:42:06 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:06 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.info" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840886573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d672269b-b028-4298-a256-2b981c27f06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:05Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Creating volume d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:06 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:06 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b 1073741824 Nov 05 08:42:06 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d4d4d55-ee4e-43df-8800-3d1b6a40d119 tempest-VolumeDependencyTests-390498562 None] Create snapshot completed successfully Nov 05 08:42:07 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b 1073741824" returned: 0 in 0.578s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (6c80ab5c-09a5-4de7-9178-8a4c4da007aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a4c6a2-78b4-4ceb-adbc-a893a57c20d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a4c6a2-78b4-4ceb-adbc-a893a57c20d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715937265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fbe7e6-c83f-4b45-84eb-ee80b3721634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:07Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20d6cf1-ecac-4985-91f5-c2a0018deba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20d6cf1-ecac-4985-91f5-c2a0018deba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8f42bb-4c55-4253-b30e-fdc7ac76d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8f42bb-4c55-4253-b30e-fdc7ac76d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4fbe7e6-c83f-4b45-84eb-ee80b3721634', 'volume_name': 'volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be28f772-9347-4408-8f39-eee4763a6f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be28f772-9347-4408-8f39-eee4763a6f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d93f6-b4b4-4751-967e-89b3198c5e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume f4fbe7e6-c83f-4b45-84eb-ee80b3721634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634', 'volume_size': 1} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b Nov 05 08:42:07 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-715937265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fbe7e6-c83f-4b45-84eb-ee80b3721634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:07Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:07 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:07 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 1073741824 Nov 05 08:42:07 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058cb447-9fda-4cd5-a3a9-1c66e07d5fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d672269b-b028-4298-a256-2b981c27f06b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82440056-872b-4379-b784-9ccf26f3b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:07 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Volume volume-d672269b-b028-4298-a256-2b981c27f06b (d672269b-b028-4298-a256-2b981c27f06b): created successfully Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82440056-872b-4379-b784-9ccf26f3b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:07 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (80740b06-9e0a-42b7-990b-9a69f91e7324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-409d5ad0-047e-4cbb-882b-8194f1cce697 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Flow 'volume_create_manager' (4a638a7a-3a15-4a6b-aa2f-948991dd1a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64be511c-5e74-4774-9b8d-367b993a823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 1073741824" returned: 0 in 0.557s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64be511c-5e74-4774-9b8d-367b993a823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-495114704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0fa227-5e6d-4f0c-843a-908175e4caa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc71e12fafa7498d8ab0ed1abb5027fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4855ee2d-cdc1-48c9-a0ec-90ea9c01b493,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:08Z,use_quota=True,user_id='bb46f7ad0f064bfca05ff2eec49bd530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e9ee5c-6b12-4c59-ab94-d8a3c9567e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e9ee5c-6b12-4c59-ab94-d8a3c9567e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899265d1-a224-4d55-8963-08cc4a723a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899265d1-a224-4d55-8963-08cc4a723a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e0fa227-5e6d-4f0c-843a-908175e4caa4', 'volume_name': 'volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4', 'volume_size': 1, 'snapshot_id': '4855ee2d-cdc1-48c9-a0ec-90ea9c01b493'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5bbdb3-4f5b-48c5-b71f-d15b4bbc0dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5bbdb3-4f5b-48c5-b71f-d15b4bbc0dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adffff5-c6f9-4907-a923-2da60a782d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Volume 1e0fa227-5e6d-4f0c-843a-908175e4caa4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4', 'volume_size': 1, 'snapshot_id': '4855ee2d-cdc1-48c9-a0ec-90ea9c01b493'} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:08 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 Nov 05 08:42:08 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:08 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.298s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-1e0fa227-5e6d-4f0c-843a-908175e4caa4" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223d93f6-b4b4-4751-967e-89b3198c5e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280d85b-5cf5-4d0f-ba33-00d34b99078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-1e0fa227-5e6d-4f0c-843a-908175e4caa4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Creating volume 1e0fa227-5e6d-4f0c-843a-908175e4caa4 from snapshot 4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 (f4fbe7e6-c83f-4b45-84eb-ee80b3721634): created successfully Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280d85b-5cf5-4d0f-ba33-00d34b99078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (6c80ab5c-09a5-4de7-9178-8a4c4da007aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] snapshot: 4855ee2d-cdc1-48c9-a0ec-90ea9c01b493, volume: 1e0fa227-5e6d-4f0c-843a-908175e4caa4, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:08 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-375625c2-4983-497e-9de5-39e6c6248acf tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacb0ac-c225-45f0-8e8e-66a76cce5eca]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:09 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:09 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:09 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.375s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b5f249-d670-4f4c-99ad-0d45663bde9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[10797bcd-1208-4e66-a445-fa42ba2feb20]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:09 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:09 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:09 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:42:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:09 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 Nov 05 08:42:09 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Flow 'volume_create_manager' (35a6c04c-dd63-4cea-a987-5640fc2ac19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1556ac64-6558-4a4f-a22a-b3ce2012912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1556ac64-6558-4a4f-a22a-b3ce2012912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e283b61-1d06-4564-9170-14e980ef98d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cc6d8b0fe14abd8c827cbdb4338057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:12Z,use_quota=True,user_id='ecc61d85304643fea0d5b205f5db4aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee204d35-6255-4ea4-87b6-b4625ff95066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee204d35-6255-4ea4-87b6-b4625ff95066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00628168-8f2b-4067-a366-74488c299da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:11 devstack cinder-volume[87092]: DEBUG cinder.image.glance [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Creating Keystone auth plugin from conf {{(pid=87092) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00628168-8f2b-4067-a366-74488c299da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e283b61-1d06-4564-9170-14e980ef98d8', 'volume_name': 'volume-2e283b61-1d06-4564-9170-14e980ef98d8', 'volume_size': 1, 'image_id': '8e694112-7576-47c9-a283-a25dce69faae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec52b21b9e89b87091e883b0a7a173a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59cc6d8b0fe14abd8c827cbdb4338057', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca8cabff988bd40dca10cfb7780fcffcd8434c745a6cc0f977556e8498b9b3c6d0c02dadeae46ad17e183120a786b725d054f0f713dda2883b08a01d081452b9', 'id': '8e694112-7576-47c9-a283-a25dce69faae', 'created_at': datetime.datetime(2026, 11, 5, 7, 42, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e694112-7576-47c9-a283-a25dce69faae/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf007132-d6a5-4100-a4cb-f81c25c13b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf007132-d6a5-4100-a4cb-f81c25c13b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae2a50-b2fc-412a-8103-54d77897fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Volume 2e283b61-1d06-4564-9170-14e980ef98d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e283b61-1d06-4564-9170-14e980ef98d8', 'volume_size': 1, 'image_id': '8e694112-7576-47c9-a283-a25dce69faae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec52b21b9e89b87091e883b0a7a173a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59cc6d8b0fe14abd8c827cbdb4338057', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca8cabff988bd40dca10cfb7780fcffcd8434c745a6cc0f977556e8498b9b3c6d0c02dadeae46ad17e183120a786b725d054f0f713dda2883b08a01d081452b9', 'id': '8e694112-7576-47c9-a283-a25dce69faae', 'created_at': datetime.datetime(2026, 11, 5, 7, 42, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e694112-7576-47c9-a283-a25dce69faae/file', 'properties': {}}, 'image_service': } Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Trying to clone 2e283b61-1d06-4564-9170-14e980ef98d8 from image 8e694112-7576-47c9-a283-a25dce69faae at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}]). {{(pid=87092) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 08:42:12 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Image download 0.00 MB at 0.00 MB/s Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11d5d9-1b91-4897-a6c5-e43515f19353]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:12 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:12 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:13 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:13 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:13 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:13 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 1 in 0.551s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Temporary image 8e694112-7576-47c9-a283-a25dce69faae is fetched for user ecc61d85304643fea0d5b205f5db4aa0. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093b5a6-fe9d-47de-90a4-809763fd2a7e]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:13 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:13 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:14 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:14 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:14 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:14 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 1 in 0.555s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:42:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:16 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4" returned: 0 in 6.770s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:42:16 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Converted 1024.00 MB image at 151.25 MB/s Nov 05 08:42:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 is being set with open permissions: ugo+rw Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 Nov 05 08:42:16 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:16 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" released by "_copy_volume_from_snapshot" :: held 7.920s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-1e0fa227-5e6d-4f0c-843a-908175e4caa4" released by "_create_volume_from_snapshot" :: held 7.996s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.030s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.177s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Creating offline snapshot 75fbeec2-bb66-4b01-9df6-92716fd06154 of volume d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adffff5-c6f9-4907-a923-2da60a782d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4', 'volume_size': 1, 'snapshot_id': '4855ee2d-cdc1-48c9-a0ec-90ea9c01b493'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c57244-4780-438a-a771-36ff46c98398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf6c78-cb44-4c87-a54f-64bd6cf9bb5b]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:16 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Volume volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 (1e0fa227-5e6d-4f0c-843a-908175e4caa4): created successfully Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c57244-4780-438a-a771-36ff46c98398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:16 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Flow 'volume_create_manager' (4a638a7a-3a15-4a6b-aa2f-948991dd1a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3d573015-6e3d-4a9d-bd8f-f8472814353c tempest-VolumeDependencyTests-390498562 None] Created volume successfully. Nov 05 08:42:16 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b Nov 05 08:42:16 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 1G Nov 05 08:42:17 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 1G" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d672269b-b028-4298-a256-2b981c27f06b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d672269b-b028-4298-a256-2b981c27f06b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 Nov 05 08:42:17 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:17 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d672269b-b028-4298-a256-2b981c27f06b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:17 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 is being set with open permissions: ugo+rw Nov 05 08:42:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:17 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 Nov 05 08:42:17 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Deleting offline snapshot 4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 of volume 27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] snapshot_file for this snap is: volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:18 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4c576-94f1-4a0e-9935-89653b090ecf]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info Nov 05 08:42:18 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:18 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:18 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info is being set with open permissions: ugo+rw Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info Nov 05 08:42:18 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.394s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b5f249-d670-4f4c-99ad-0d45663bde9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:18 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb1af55-3d82-4231-a9d9-4263a85b374c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:42:18 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:18 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:18 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.info" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.051s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating offline snapshot 6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 of volume f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-676b49c6-3141-4e6f-a1f0-edf847c9176c tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe0afa-d6a5-48a5-b5bd-80e58929b58f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:18 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 Nov 05 08:42:18 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.605s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" returned: 0 in 0.414s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:19 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-75fbeec2-bb66-4b01-9df6-92716fd06154-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 1G Nov 05 08:42:19 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-75fbeec2-bb66-4b01-9df6-92716fd06154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-75fbeec2-bb66-4b01-9df6-92716fd06154" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-75fbeec2-bb66-4b01-9df6-92716fd06154" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot 75fbeec2-bb66-4b01-9df6-92716fd06154 of volume d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e6581-2f56-453f-9649-1f84ae1a295e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 Nov 05 08:42:19 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493 Nov 05 08:42:19 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 1G" returned: 0 in 0.534s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d672269b-b028-4298-a256-2b981c27f06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:19 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 Nov 05 08:42:19 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7eaafe-c6bc-4470-8c53-93dba0818d42]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:19 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c.4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:19 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b Nov 05 08:42:19 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493" released by "_delete_snapshot" :: held 1.858s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" released by "delete_snapshot" :: held 1.880s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Created reservations ['e52cfa14-e172-45c6-86ee-12cfd754a148', '88c14985-2cdc-459a-8e27-093ffc0453e3', '12b6ccda-f1fc-4575-ba27-0f0a851dcab1', '37471a88-6119-4921-a1d4-86d85b0eae98'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:20 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 is being set with open permissions: ugo+rw Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Delete snapshot completed successfully. Nov 05 08:42:20 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 Nov 05 08:42:20 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-12b7599c-8abd-4bba-a14d-6ac47356963d tempest-VolumeDependencyTests-390498562 None] Lock "cinder-4855ee2d-cdc1-48c9-a0ec-90ea9c01b493-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-27b5f249-d670-4f4c-99ad-0d45663bde9c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:20 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-27b5f249-d670-4f4c-99ad-0d45663bde9c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:20 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 Nov 05 08:42:20 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:20 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a2249b-c90f-43f7-b889-e95608d89e57]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info Nov 05 08:42:20 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:20 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154" returned: 0 in 0.371s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154 Nov 05 08:42:20 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info is being set with open permissions: ugo+rw Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info Nov 05 08:42:20 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:20 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c Nov 05 08:42:20 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:20 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b.75fbeec2-bb66-4b01-9df6-92716fd06154" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-75fbeec2-bb66-4b01-9df6-92716fd06154" released by "_delete_snapshot" :: held 1.677s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" released by "delete_snapshot" :: held 1.709s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.info" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.206s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e283b61-1d06-4564-9170-14e980ef98d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cc6d8b0fe14abd8c827cbdb4338057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:12Z,use_quota=True,user_id='ecc61d85304643fea0d5b205f5db4aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Creating volume 2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:21 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1073741824 Nov 05 08:42:21 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:21 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2baeee7f-889e-42a5-baa1-d592fa46a6e0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Create snapshot completed successfully Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-27b5f249-d670-4f4c-99ad-0d45663bde9c" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-27b5f249-d670-4f4c-99ad-0d45663bde9c" released by "delete_volume" :: held 0.737s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Created reservations ['97a74a49-45cf-4102-9a13-d574191fcfad', 'e5d9a597-5638-48c1-a5a4-91396c7699e7', 'dff2ce36-71e7-4f64-b4f1-b726e5e586ee', 'dbd9a758-b06f-48b2-b2bc-37284c1c972a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f92e5d83-421a-4655-ad3f-643fd0dda4b6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-75fbeec2-bb66-4b01-9df6-92716fd06154-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Created reservations ['7eafe2db-8f8a-4a0b-90b3-b4555221cb85', '2f45b46e-d3f4-4051-9783-4152e2c51bbc', 'd2341b4b-70ce-4251-855d-2ea3c2760e6d', '3101d008-4f88-42fb-960a-f14388a4ffd7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:21 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-1e0fa227-5e6d-4f0c-843a-908175e4caa4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-1e0fa227-5e6d-4f0c-843a-908175e4caa4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-d672269b-b028-4298-a256-2b981c27f06b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1073741824" returned: 0 in 0.690s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:21 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.450s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42bc1ff-fed5-43e7-b58c-c0fbb8b89e13]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Deleted volume successfully. Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "cinder-d672269b-b028-4298-a256-2b981c27f06b-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1cf9257-1365-4741-b4e6-72ae6a307db6 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-27b5f249-d670-4f4c-99ad-0d45663bde9c-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:21 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:21 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" acquired by "delete_volume" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00291c-9103-4a58-b571-e36e3a4f8ab2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 Nov 05 08:42:22 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b Nov 05 08:42:22 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (658a9a28-f525-471a-863e-c6f7092d6446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11076f08-0208-4428-8018-b058e989272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:22 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11076f08-0208-4428-8018-b058e989272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272397551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec2a879-a8ef-42ed-b0f2-161ede7795a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:22Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e84a90-7519-44b1-a75f-5eec5fb534ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e84a90-7519-44b1-a75f-5eec5fb534ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc007b1-38b2-4dbf-bc48-293d11676fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc007b1-38b2-4dbf-bc48-293d11676fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec2a879-a8ef-42ed-b0f2-161ede7795a5', 'volume_name': 'volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c16278-6f6b-42fe-8b48-27dee0b7191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c16278-6f6b-42fe-8b48-27dee0b7191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc530cf7-cd91-4957-b177-bc0359de1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:22 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume 4ec2a879-a8ef-42ed-b0f2-161ede7795a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5', 'volume_size': 1} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8" returned: 0 in 0.523s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272397551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec2a879-a8ef-42ed-b0f2-161ede7795a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:22Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume 4ec2a879-a8ef-42ed-b0f2-161ede7795a5 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:22 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4" returned: 0 in 0.651s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 1073741824 Nov 05 08:42:22 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4 Nov 05 08:42:22 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Attempting download of 8e694112-7576-47c9-a283-a25dce69faae ((None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}])) to volume 2e283b61-1d06-4564-9170-14e980ef98d8. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a1b2f-8761-407e-8b6e-48e7a6c8e39d]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty Nov 05 08:42:22 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b" returned: 0 in 0.732s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:22 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1e0fa227-5e6d-4f0c-843a-908175e4caa4" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:22 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b Nov 05 08:42:22 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-quobyte-1e0fa227-5e6d-4f0c-843a-908175e4caa4" released by "delete_volume" :: held 1.113s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:22 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Created reservations ['810d2a6b-8eef-4177-bde2-24ecd25e9387', '99b28def-642f-46eb-8a1b-9134303f4b42', '73ce55cf-e38b-4cd2-9004-32a90142975a', '30a890e9-8b8f-4d9b-819d-769dd7b892d8'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (5a7a9353-2bdb-4b5d-94a8-5b100445c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6b362-0f44-410c-b35b-e51f0b24ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6b362-0f44-410c-b35b-e51f0b24ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189874971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62782d0e-dd77-4099-9fd9-c5a37c4e93c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:23Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816fbf0f-f6d3-4d10-9880-6933f6819503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816fbf0f-f6d3-4d10-9880-6933f6819503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e499b8a1-046b-4978-b25f-c9475cfac0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e499b8a1-046b-4978-b25f-c9475cfac0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62782d0e-dd77-4099-9fd9-c5a37c4e93c9', 'volume_name': 'volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba0b078-4f08-4a99-858d-46fbb3a1ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba0b078-4f08-4a99-858d-46fbb3a1ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e791c2-e71e-43e8-8b06-567ac1997726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume 62782d0e-dd77-4099-9fd9-c5a37c4e93c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9', 'volume_size': 1} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 1073741824" returned: 0 in 0.845s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d672269b-b028-4298-a256-2b981c27f06b" returned: 0 in 0.478s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty" returned: 0 in 0.692s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d672269b-b028-4298-a256-2b981c27f06b" released by "delete_volume" :: held 1.361s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 Nov 05 08:42:23 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty Nov 05 08:42:23 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:23 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (0c397e33-d7f1-4f55-a83a-554f7d5d05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:23 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b49c48-f144-45fb-aa83-0a947a07e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Created reservations ['b75b28d6-2ba6-4bec-901b-82802b323b97', '1453130c-c149-47d5-ae30-7fb1c5a99303', '699fd635-7080-463e-a79e-1c192167113e', 'b5573254-84b9-4b3f-8258-645c183f730d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b49c48-f144-45fb-aa83-0a947a07e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31746472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ebc0ba-ace2-4908-97a0-f6910b9732bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:23Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a332e9cb-af47-4c7e-91b3-e0c114f00453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a332e9cb-af47-4c7e-91b3-e0c114f00453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73caf907-3d20-478e-a9f1-3cb1c9abbed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73caf907-3d20-478e-a9f1-3cb1c9abbed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ebc0ba-ace2-4908-97a0-f6910b9732bf', 'volume_name': 'volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62e3293-0d0c-443e-bb41-a87454aceee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62e3293-0d0c-443e-bb41-a87454aceee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be28e4c-af34-40be-bccd-e6ba0515b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume 58ebc0ba-ace2-4908-97a0-f6910b9732bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf', 'volume_size': 1} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:23 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:23 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189874971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62782d0e-dd77-4099-9fd9-c5a37c4e93c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:23Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume 62782d0e-dd77-4099-9fd9-c5a37c4e93c9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:23 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc530cf7-cd91-4957-b177-bc0359de1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb4bf3-e402-4bab-905d-ef295c3171bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:23 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 1073741824 Nov 05 08:42:23 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:23 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 (4ec2a879-a8ef-42ed-b0f2-161ede7795a5): created successfully Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb4bf3-e402-4bab-905d-ef295c3171bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (658a9a28-f525-471a-863e-c6f7092d6446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-85fc1f61-0abb-4c1c-b270-ac0b548339c0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:23 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty" returned: 1 in 0.626s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e694112-7576-47c9-a283-a25dce69faae_vsnkxnty' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed05a27-0f61-4e0f-8c00-8e31150e4a5f]: (4, 'raw') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:23 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.586s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Deleted volume successfully. Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (6d57d7e9-8c2d-4a9c-9f18-7be98fdcb9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13921cd0-c18e-4ccb-b0fb-c058e35d4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cb6642d9-a270-47d5-8fb9-bd8190452444 tempest-VolumeDependencyTests-390498562 None] Lock "cinder-1e0fa227-5e6d-4f0c-843a-908175e4caa4-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13921cd0-c18e-4ccb-b0fb-c058e35d4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049271154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5bcc49-d6be-46d5-a140-b3b6901e5a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:24Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebaf656-1e78-4c6a-951a-7cda743d7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebaf656-1e78-4c6a-951a-7cda743d7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e72c0b-2712-4146-813e-2e6ef60bb115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e72c0b-2712-4146-813e-2e6ef60bb115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5bcc49-d6be-46d5-a140-b3b6901e5a5c', 'volume_name': 'volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c22f4a5-0909-4be3-bcd4-22889cb3704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c22f4a5-0909-4be3-bcd4-22889cb3704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d095a2bc-d846-44af-8997-7f6d157a7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume 6a5bcc49-d6be-46d5-a140-b3b6901e5a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c', 'volume_size': 1} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.507s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:24 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b43d701-1841-4ed5-b83c-671e6112008b tempest-ProjectMemberTests-78095360 None] Lock "cinder-d672269b-b028-4298-a256-2b981c27f06b-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:24 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:24 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 1073741824" returned: 0 in 0.755s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:24 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 Nov 05 08:42:24 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:24 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD Nov 05 08:42:24 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (02a25479-99c9-4436-b724-084796df2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464fdf8d-d00d-4cb8-996b-f2a23fc9c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464fdf8d-d00d-4cb8-996b-f2a23fc9c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2944492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc03912-086b-499b-89d9-dd029a3dce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4361cd-912a-4b69-8b1c-ebe880217aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4361cd-912a-4b69-8b1c-ebe880217aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44d0431-ddae-41f5-834c-cf4188937352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44d0431-ddae-41f5-834c-cf4188937352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc03912-086b-499b-89d9-dd029a3dce34', 'volume_name': 'volume-4dc03912-086b-499b-89d9-dd029a3dce34', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d94b2-35d2-42d0-bb92-2364fee64054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d94b2-35d2-42d0-bb92-2364fee64054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b5f035-3d12-4367-9e1a-e8ab729b43a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume 4dc03912-086b-499b-89d9-dd029a3dce34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc03912-086b-499b-89d9-dd029a3dce34', 'volume_size': 1} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (238cd435-4dfb-4ee5-9378-f7cf62b1e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:24 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7e24f0-25b1-4619-891a-dbe21dbc0b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD" returned: 1 in 0.568s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] 8e694112-7576-47c9-a283-a25dce69faae was raw, converting to qcow2 {{(pid=87092) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 08:42:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:25 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7e24f0-25b1-4619-891a-dbe21dbc0b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811555116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4b06b-1d82-4ba6-97d4-ece79f0f0826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 Nov 05 08:42:25 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09404ae4-188f-48df-86e1-8ec5d84047ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09404ae4-188f-48df-86e1-8ec5d84047ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a631d27-4d05-4365-b519-035beceb7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a631d27-4d05-4365-b519-035beceb7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb4b06b-1d82-4ba6-97d4-ece79f0f0826', 'volume_name': 'volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885df19a-b812-44f7-9e7d-0f0d7543036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885df19a-b812-44f7-9e7d-0f0d7543036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5e1c3a-67a8-4a63-9f7d-494696988d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Volume 3eb4b06b-1d82-4ba6-97d4-ece79f0f0826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826', 'volume_size': 1} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" returned: 0 in 0.508s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-31746472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ebc0ba-ace2-4908-97a0-f6910b9732bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:23Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume 58ebc0ba-ace2-4908-97a0-f6910b9732bf {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:25 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e791c2-e71e-43e8-8b06-567ac1997726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dad133-93a7-4f2f-a768-526ecfb5cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:25 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf 1073741824 Nov 05 08:42:25 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 (62782d0e-dd77-4099-9fd9-c5a37c4e93c9): created successfully Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dad133-93a7-4f2f-a768-526ecfb5cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (5a7a9353-2bdb-4b5d-94a8-5b100445c4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ee0c6d14-0f19-41d7-989c-f79175a787b2 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:25 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8" returned: 0 in 0.560s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e694112-7576-47c9-a283-a25dce69faae_k9lyxd43devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:42:25 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:25 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf 1073741824" returned: 0 in 0.512s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:25 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1G Nov 05 08:42:25 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:25 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf Nov 05 08:42:25 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:25 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049271154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5bcc49-d6be-46d5-a140-b3b6901e5a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:24Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume 6a5bcc49-d6be-46d5-a140-b3b6901e5a5c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:26 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 1G" returned: 0 in 0.467s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Downloaded image 8e694112-7576-47c9-a283-a25dce69faae ((None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}])) to volume 2e283b61-1d06-4564-9170-14e980ef98d8 successfully. {{(pid=87092) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Temporary image 8e694112-7576-47c9-a283-a25dce69faae for user ecc61d85304643fea0d5b205f5db4aa0 is deleted. {{(pid=87092) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.volume_utils [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Marking volume 2e283b61-1d06-4564-9170-14e980ef98d8 as bootable. {{(pid=87092) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 08:42:26 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c 1073741824 Nov 05 08:42:26 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be28e4c-af34-40be-bccd-e6ba0515b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80b231e-0a72-4305-b4f6-ff6c3ed0f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Copying metadata from image 8e694112-7576-47c9-a283-a25dce69faae to 2e283b61-1d06-4564-9170-14e980ef98d8. {{(pid=87092) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Creating volume glance metadata for volume 2e283b61-1d06-4564-9170-14e980ef98d8 backed by image 8e694112-7576-47c9-a283-a25dce69faae with: {'image_id': '8e694112-7576-47c9-a283-a25dce69faae', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ec52b21b9e89b87091e883b0a7a173a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87092) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf (58ebc0ba-ace2-4908-97a0-f6910b9732bf): created successfully Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80b231e-0a72-4305-b4f6-ff6c3ed0f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (0c397e33-d7f1-4f55-a83a-554f7d5d05ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c5a76f0b-e975-412a-b0a0-eb8bdec78529 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ae2a50-b2fc-412a-8103-54d77897fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e283b61-1d06-4564-9170-14e980ef98d8', 'volume_size': 1, 'image_id': '8e694112-7576-47c9-a283-a25dce69faae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e694112-7576-47c9-a283-a25dce69faae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ec52b21b9e89b87091e883b0a7a173a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59cc6d8b0fe14abd8c827cbdb4338057', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca8cabff988bd40dca10cfb7780fcffcd8434c745a6cc0f977556e8498b9b3c6d0c02dadeae46ad17e183120a786b725d054f0f713dda2883b08a01d081452b9', 'id': '8e694112-7576-47c9-a283-a25dce69faae', 'created_at': datetime.datetime(2026, 11, 5, 7, 42, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 7, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e694112-7576-47c9-a283-a25dce69faae/file', 'properties': {}}, 'image_service': }' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18869c8c-a9f8-40cf-a587-54363efe5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Volume volume-2e283b61-1d06-4564-9170-14e980ef98d8 (2e283b61-1d06-4564-9170-14e980ef98d8): created successfully Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18869c8c-a9f8-40cf-a587-54363efe5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Flow 'volume_create_manager' (35a6c04c-dd63-4cea-a987-5640fc2ac19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c2fa0f99-d45a-4228-90fe-7ba784dcc368 tempest-VolumeImageDependencyTests-1574854577 None] Created volume successfully. Nov 05 08:42:26 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c 1073741824" returned: 0 in 0.508s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:26 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c Nov 05 08:42:26 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:26 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2944492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc03912-086b-499b-89d9-dd029a3dce34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a313bf9e099c41d79d3f66d43dd926c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='98f1797f90724753aedccab3e4bd132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Creating volume 4dc03912-086b-499b-89d9-dd029a3dce34 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d095a2bc-d846-44af-8997-7f6d157a7b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 1073741824 Nov 05 08:42:26 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd7fcf0-6c71-4965-93e5-ab8d254b1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c (6a5bcc49-d6be-46d5-a140-b3b6901e5a5c): created successfully Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd7fcf0-6c71-4965-93e5-ab8d254b1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (6d57d7e9-8c2d-4a9c-9f18-7be98fdcb9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-55c13707-442c-44f7-a5b3-1679765c318d tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Acquiring lock "cinder-2e283b61-1d06-4564-9170-14e980ef98d8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "cinder-2e283b61-1d06-4564-9170-14e980ef98d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Acquiring lock "cinder-quobyte-2e283b61-1d06-4564-9170-14e980ef98d8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "cinder-quobyte-2e283b61-1d06-4564-9170-14e980ef98d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a90d9-888e-443e-a0f7-220136e91379]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:27 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 Nov 05 08:42:27 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:27 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 1073741824" returned: 0 in 0.582s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:27 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 Nov 05 08:42:27 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:27 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8" returned: 0 in 0.425s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:27 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8 Nov 05 08:42:27 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:27 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-811555116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4b06b-1d82-4ba6-97d4-ece79f0f0826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:25Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Creating volume 3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:27 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:27 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 1073741824 Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b5f035-3d12-4367-9e1a-e8ab729b43a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc03912-086b-499b-89d9-dd029a3dce34', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:27 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f812b181-9157-40eb-bea3-67e0aef6d8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:27 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Volume volume-4dc03912-086b-499b-89d9-dd029a3dce34 (4dc03912-086b-499b-89d9-dd029a3dce34): created successfully Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f812b181-9157-40eb-bea3-67e0aef6d8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Flow 'volume_create_manager' (02a25479-99c9-4436-b724-084796df2c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:27 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c28150e3-d18d-4620-875e-960abf0380be tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created volume successfully. Nov 05 08:42:27 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e283b61-1d06-4564-9170-14e980ef98d8" returned: 0 in 0.292s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:27 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "cinder-quobyte-2e283b61-1d06-4564-9170-14e980ef98d8" released by "delete_volume" :: held 0.772s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Created reservations ['3e60b5c4-2560-422a-af1a-bf3b609a5e15', 'eb8448bc-a5d5-4fce-830a-ba1507463c23', '4c2005d7-e481-48fa-a595-c376c528617e', 'a0c26c38-6a06-421b-aec4-051d132097a1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:28 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-4dc03912-086b-499b-89d9-dd029a3dce34-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-4dc03912-086b-499b-89d9-dd029a3dce34-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-4dc03912-086b-499b-89d9-dd029a3dce34" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-4dc03912-086b-499b-89d9-dd029a3dce34" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927bc45-e36d-47aa-b99d-476c1886dbe8]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 1073741824" returned: 0 in 0.703s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 Nov 05 08:42:28 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 Nov 05 08:42:28 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.439s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Deleted volume successfully. Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1d128c37-0426-4da8-ad4a-6674f7edfe1d tempest-VolumeImageDependencyTests-1574854577 None] Lock "cinder-2e283b61-1d06-4564-9170-14e980ef98d8-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:28 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:28 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5e1c3a-67a8-4a63-9f7d-494696988d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63716a3-d823-4757-aa55-47a1eaf07669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:28 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Volume volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 (3eb4b06b-1d82-4ba6-97d4-ece79f0f0826): created successfully Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63716a3-d823-4757-aa55-47a1eaf07669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:28 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (238cd435-4dfb-4ee5-9378-f7cf62b1e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:28 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34 Nov 05 08:42:28 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ce3ebabc-a0a6-4127-921b-b3e85b426921 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (ccdf5d9d-c00b-42d5-bd29-f24d8d4d531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25aacc2b-cc5d-4c08-abe2-a68a91c55a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25aacc2b-cc5d-4c08-abe2-a68a91c55a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384435937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e1fbad-47c9-4471-b59d-07596f4b3b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:29Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09f4784-3a0a-49ae-8cd0-b54e96303549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09f4784-3a0a-49ae-8cd0-b54e96303549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b730d8ba-eddc-411d-85f1-87bc217d1e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b730d8ba-eddc-411d-85f1-87bc217d1e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e1fbad-47c9-4471-b59d-07596f4b3b1d', 'volume_name': 'volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7d098-ec8c-4753-8328-09be19954a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b7d098-ec8c-4753-8328-09be19954a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c15d1-2f33-42a7-8770-3f93b2908822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:29 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Volume d4e1fbad-47c9-4471-b59d-07596f4b3b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d', 'volume_size': 1} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1384435937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e1fbad-47c9-4471-b59d-07596f4b3b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:29Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Creating volume d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:29 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4dc03912-086b-499b-89d9-dd029a3dce34" returned: 0 in 0.313s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d 1073741824 Nov 05 08:42:29 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-4dc03912-086b-499b-89d9-dd029a3dce34" released by "delete_volume" :: held 0.874s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['a21479e1-1a10-4441-9428-704757f3f57e', '173c8583-49fc-4aa6-9adf-4048228617de', 'aca865ba-d971-463a-9043-f45ebf6558f9', 'adaf2adf-ee74-4468-a09e-a186e6a09cbf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:29 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae1070d-2871-483c-b13c-c2688690869a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d 1073741824" returned: 0 in 0.600s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:29 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c Nov 05 08:42:29 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:29 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:29 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f370615c-c3e5-4f12-98ff-3cc9f4762542 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-4dc03912-086b-499b-89d9-dd029a3dce34-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:29 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d Nov 05 08:42:29 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:30 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.639s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074c15d1-2f33-42a7-8770-3f93b2908822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:30 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c645b99-03cb-4c40-aa34-10942405d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" returned: 0 in 0.494s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Creating offline snapshot f14b6a95-8465-490c-9b4a-c46d44dc9ef4 of volume 3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:30 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Volume volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d (d4e1fbad-47c9-4471-b59d-07596f4b3b1d): created successfully Nov 05 08:42:30 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c Nov 05 08:42:30 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c645b99-03cb-4c40-aa34-10942405d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (ccdf5d9d-c00b-42d5-bd29-f24d8d4d531d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1618fb-6342-43c0-9d65-dbd94887e508]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-761223d5-d132-481b-924c-3750d59bc5a2 tempest-ProjectReaderTests-1788288151 None] Created volume successfully. Nov 05 08:42:30 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 Nov 05 08:42:30 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:30 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" returned: 0 in 0.300s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c" released by "delete_volume" :: held 0.871s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['4ce94537-030a-426e-aa32-c5cd7c18f06c', 'a7971724-1975-4df3-9f3a-38a98bdf2d3a', '5254f88d-177c-44a3-aa54-6a7f7e72a7e4', '57714756-6fbe-4ae7-8064-adcf9cabbca4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:30 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" returned: 0 in 0.465s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:30 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 1G Nov 05 08:42:30 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:30 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:30 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-58ebc0ba-ace2-4908-97a0-f6910b9732bf-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-58ebc0ba-ace2-4908-97a0-f6910b9732bf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-58ebc0ba-ace2-4908-97a0-f6910b9732bf" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-58ebc0ba-ace2-4908-97a0-f6910b9732bf" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0aae30-073c-4643-9076-22ecbe2c529d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf Nov 05 08:42:31 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.348s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:31 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-3762f0f0-56c1-4fa5-b0d2-7e5672a29544 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-6a5bcc49-d6be-46d5-a140-b3b6901e5a5c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:31 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 1G" returned: 0 in 0.586s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 Nov 05 08:42:31 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf" returned: 0 in 0.518s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:31 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf Nov 05 08:42:31 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4" returned: 0 in 0.392s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 is being set with open permissions: ugo+rw Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-58ebc0ba-ace2-4908-97a0-f6910b9732bf" returned: 0 in 0.305s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:31 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 Nov 05 08:42:31 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-58ebc0ba-ace2-4908-97a0-f6910b9732bf" released by "delete_volume" :: held 0.878s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['1c464ddb-e032-4b13-8dcf-800cae8587c6', '07d74e0b-3e71-4cbc-b047-00142045e450', '907e1c0d-1bf0-4146-b5dd-df9b509a1108', '87ea5877-0b76-46dc-a5b9-73c94d1aea37'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:31 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:31 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-62782d0e-dd77-4099-9fd9-c5a37c4e93c9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-62782d0e-dd77-4099-9fd9-c5a37c4e93c9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:31 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4" returned: 0 in 0.335s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:32 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info Nov 05 08:42:32 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2de467-7f9c-4c58-bc69-5775fafdae68]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.353s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9513081e-5a2c-483b-9831-d5e5166de1fe tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-58ebc0ba-ace2-4908-97a0-f6910b9732bf-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:32 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 Nov 05 08:42:32 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info" returned: 0 in 0.328s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info is being set with open permissions: ugo+rw Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info Nov 05 08:42:32 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" returned: 0 in 0.449s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9 Nov 05 08:42:32 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.info" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.272s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Creating offline snapshot 1da55d61-7b9d-40f4-b163-f7129379532f of volume d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-508a69c9-7918-4fa0-8f57-9c47b932e530 tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1e915-df19-4b25-bf57-53bdd35ebf1c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:32 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:32 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d Nov 05 08:42:32 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-62782d0e-dd77-4099-9fd9-c5a37c4e93c9" released by "delete_volume" :: held 0.792s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['7ddb6c36-4a74-4e91-b653-2008d7caf7a3', 'e985078b-69ca-485a-9440-399dba04492f', 'f1cdea43-4b1b-47af-b399-b22f1f3b52b0', 'b8ee7907-faff-4559-9222-6f86f6e50695'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:33 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-4ec2a879-a8ef-42ed-b0f2-161ede7795a5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f 1G Nov 05 08:42:33 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-4ec2a879-a8ef-42ed-b0f2-161ede7795a5-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.336s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" acquired by "delete_volume" :: waited 0.033s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[467cbf2c-fa77-4cdb-a95c-dbc3a278ce89]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-4d0d5294-fd09-4678-a54d-e6ab503186b0 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-62782d0e-dd77-4099-9fd9-c5a37c4e93c9-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:33 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 Nov 05 08:42:33 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-f14b6a95-8465-490c-9b4a-c46d44dc9ef4-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-f14b6a95-8465-490c-9b4a-c46d44dc9ef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f 1G" returned: 0 in 0.590s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-f14b6a95-8465-490c-9b4a-c46d44dc9ef4" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:33 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f Nov 05 08:42:33 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-f14b6a95-8465-490c-9b4a-c46d44dc9ef4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot f14b6a95-8465-490c-9b4a-c46d44dc9ef4 of volume 3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35c7d5-28fa-4b50-8c0f-029864753f96]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" returned: 0 in 0.466s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:33 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:33 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5 Nov 05 08:42:33 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:33 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 Nov 05 08:42:33 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f" returned: 0 in 0.344s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f is being set with open permissions: ugo+rw Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f Nov 05 08:42:34 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-4ec2a879-a8ef-42ed-b0f2-161ede7795a5" released by "delete_volume" :: held 0.840s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['51a7ac1f-d959-40f2-8ebf-09c65dde8899', 'beae54a9-309d-4664-83a0-469d13d4c255', '8e0651d5-1344-43da-b1e1-a8d3f587f9c0', '1bbecbeb-06f8-4410-bdad-af2097ed09bc'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:34 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4" returned: 0 in 0.454s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc6212-8fd4-4dce-b7a2-0235e88d71fd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:34 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f" returned: 0 in 0.326s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:34 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info Nov 05 08:42:34 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 Nov 05 08:42:34 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:34 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:34 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info" returned: 0 in 0.301s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info is being set with open permissions: ugo+rw Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1963d506-68ba-45bf-84de-69cc0d869f89 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-4ec2a879-a8ef-42ed-b0f2-161ede7795a5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:34 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info Nov 05 08:42:34 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:34 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" returned: 0 in 0.493s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:34 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:34 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 Nov 05 08:42:34 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:35 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.info" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-963e9160-dc22-4730-bff9-0b9f9e907498 tempest-ProjectReaderTests-1788288151 None] Create snapshot completed successfully Nov 05 08:42:35 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:35 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4 Nov 05 08:42:35 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:35 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826.f14b6a95-8465-490c-9b4a-c46d44dc9ef4" returned: 0 in 0.304s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleting offline snapshot 6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 of volume f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] snapshot_file for this snap is: volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-f14b6a95-8465-490c-9b4a-c46d44dc9ef4" released by "_delete_snapshot" :: held 1.809s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" released by "delete_snapshot" :: held 1.836s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[832789f7-4f06-4dde-a09d-145367d97a1c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Created reservations ['0e6c8cce-d823-4712-8c26-3a6214df4683', '7fc83a49-fd54-4fd7-b2a7-294b958ac032', 'ce6a01e0-b044-4efc-bab6-54a07c5e08c8', '5516cf43-eda9-4e86-92c6-c93d1bc5a69b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:35 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 Nov 05 08:42:35 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:35 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-497910f8-235d-418b-83fe-4d279f55f38a tempest-ProjectMemberTests-78095360 None] Lock "cinder-f14b6a95-8465-490c-9b4a-c46d44dc9ef4-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "cinder-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:35 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-1da55d61-7b9d-40f4-b163-f7129379532f-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-1da55d61-7b9d-40f4-b163-f7129379532f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-1da55d61-7b9d-40f4-b163-f7129379532f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:36 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1da55d61-7b9d-40f4-b163-f7129379532f" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Deleting offline snapshot 1da55d61-7b9d-40f4-b163-f7129379532f of volume d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] snapshot_file for this snap is: volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ada4f-6363-49aa-a12f-8002c0b0271c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" returned: 0 in 0.549s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb798f-fa5e-4b85-9b58-325909e2b1a0]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5d53a4-e6db-44fb-a4bc-ecea832d8cea]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 Nov 05 08:42:36 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f Nov 05 08:42:36 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 Nov 05 08:42:36 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f" returned: 0 in 0.470s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:36 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826 Nov 05 08:42:36 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b558e24-b214-418d-93f6-d1cba9dc2f8f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:36 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 Nov 05 08:42:36 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d Nov 05 08:42:36 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:36 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:36 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826" released by "delete_volume" :: held 0.903s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Created reservations ['9b434e61-420c-482a-94d1-196bdbe38964', '831f7bba-f0ed-4631-83ff-c6f4df42d4cb', 'a2ab558d-1800-4cb0-8305-47962bcc1db3', 'c2c00bba-2ddd-4253-9571-19d51470e214'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:37 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" returned: 0 in 0.473s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:37 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1 Nov 05 08:42:37 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f Nov 05 08:42:37 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634.6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.398s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1" released by "_delete_snapshot" :: held 2.051s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" released by "delete_snapshot" :: held 2.128s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-bd14903c-b350-460b-9de6-4a19a9242595 tempest-ProjectMemberTests-78095360 None] Lock "cinder-3eb4b06b-1d82-4ba6-97d4-ece79f0f0826-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['3c347f1b-7b51-4570-bc14-0189da70354b', '77e9b225-9957-4893-bb9c-61db5de45619', 'bc9f01fb-079b-4b85-b2dc-a74bc85dc1bc', '989caab3-6036-4ff7-b0c1-e0d35eea4be3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:37 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f" returned: 0 in 0.577s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Delete snapshot completed successfully. Nov 05 08:42:37 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f Nov 05 08:42:37 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5cdb273b-74ac-4527-b8c2-f5788dfa1b7e tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-6175c2eb-8bf6-42ce-ab15-7d2b10d08cd1-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (c8ac4455-8205-470e-ab45-90c7d24be7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16290b8-e72c-4d40-8af3-f5fcbf429b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16290b8-e72c-4d40-8af3-f5fcbf429b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653693453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04d4416-3268-44c7-8e94-c1a6a7d727f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7716b0-3451-4eac-9ad4-cf028aafad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7716b0-3451-4eac-9ad4-cf028aafad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ccd0a-edcd-430a-b014-b8f47782134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ccd0a-edcd-430a-b014-b8f47782134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04d4416-3268-44c7-8e94-c1a6a7d727f4', 'volume_name': 'volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09a2e7f-da76-47b2-aac1-a6ebb19937f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09a2e7f-da76-47b2-aac1-a6ebb19937f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab77864d-36ef-4385-a49d-c2202d39056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:37 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Volume e04d4416-3268-44c7-8e94-c1a6a7d727f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4', 'volume_size': 1} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653693453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04d4416-3268-44c7-8e94-c1a6a7d727f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Creating volume e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:37 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:37 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:37 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 1073741824 Nov 05 08:42:37 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d.1da55d61-7b9d-40f4-b163-f7129379532f" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1da55d61-7b9d-40f4-b163-f7129379532f" released by "_delete_snapshot" :: held 2.005s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" released by "delete_snapshot" :: held 2.075s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Created reservations ['71706843-a0d1-4374-a9dc-167bb1d89f41', '6ea1c528-bd1e-499b-862d-187e2003cc33', '637df794-121f-478a-baec-6558d9dc1e57', '106337c0-4ea4-4005-ad3b-3ee71824e436'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Flow 'volume_create_manager' (6ced9314-3864-48e2-b1dc-c7e50b79cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0030d5-bc5b-4baf-9c5f-aef04b57850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Delete snapshot completed successfully. Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0030d5-bc5b-4baf-9c5f-aef04b57850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353258873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d4abe1-7a19-47c1-b708-936532e178e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57e190cf964c5c8963917f1f02ea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='5f9efaa91c39432a9497f7a449d2be45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a8f51f-09f9-4e68-9992-17f14c615b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a8f51f-09f9-4e68-9992-17f14c615b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159bfd6-265b-4cd9-8d67-0045d23e559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f159bfd6-265b-4cd9-8d67-0045d23e559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d4abe1-7a19-47c1-b708-936532e178e9', 'volume_name': 'volume-f0d4abe1-7a19-47c1-b708-936532e178e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307389e7-bf64-4190-bc8e-d4d527f10f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (307389e7-bf64-4190-bc8e-d4d527f10f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3060d63-4e8d-475c-b036-7e224f912212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Volume f0d4abe1-7a19-47c1-b708-936532e178e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d4abe1-7a19-47c1-b708-936532e178e9', 'volume_size': 1} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-aa2cd769-c90c-498b-a61b-1b7638849ce0 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-1da55d61-7b9d-40f4-b163-f7129379532f-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:38 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 1073741824" returned: 0 in 0.483s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 Nov 05 08:42:38 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353258873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d4abe1-7a19-47c1-b708-936532e178e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57e190cf964c5c8963917f1f02ea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:38Z,use_quota=True,user_id='5f9efaa91c39432a9497f7a449d2be45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Creating volume f0d4abe1-7a19-47c1-b708-936532e178e9 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:38 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:38 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 1073741824 Nov 05 08:42:38 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab77864d-36ef-4385-a49d-c2202d39056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02ec418-a4a2-4981-8ac1-65a9b881af64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-f4fbe7e6-c83f-4b45-84eb-ee80b3721634-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-f4fbe7e6-c83f-4b45-84eb-ee80b3721634-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:38 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Volume volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 (e04d4416-3268-44c7-8e94-c1a6a7d727f4): created successfully Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02ec418-a4a2-4981-8ac1-65a9b881af64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (c8ac4455-8205-470e-ab45-90c7d24be7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:38 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-051bbc39-26dc-46c9-be4b-d2eb71fe8cb6 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" acquired by "delete_volume" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0811b8-74c8-4067-b1f5-79711ba54a13]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:38 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 Nov 05 08:42:39 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-d4e1fbad-47c9-4471-b59d-07596f4b3b1d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:39 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 1073741824" returned: 0 in 0.502s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-d4e1fbad-47c9-4471-b59d-07596f4b3b1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" acquired by "delete_volume" :: waited 0.031s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:39 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 Nov 05 08:42:39 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" returned: 0 in 0.436s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71bce5-1198-43f6-8c67-4740276f866e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634 Nov 05 08:42:39 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d Nov 05 08:42:39 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3060d63-4e8d-475c-b036-7e224f912212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d4abe1-7a19-47c1-b708-936532e178e9', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb45cc48-7503-4beb-9e9a-3353cc67a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:39 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Volume volume-f0d4abe1-7a19-47c1-b708-936532e178e9 (f0d4abe1-7a19-47c1-b708-936532e178e9): created successfully Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb45cc48-7503-4beb-9e9a-3353cc67a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Flow 'volume_create_manager' (6ced9314-3864-48e2-b1dc-c7e50b79cfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:39 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6f9ef921-d182-408a-a0a2-39c55525dbd8 tempest-ProjectReaderTests-2145452193 None] Created volume successfully. Nov 05 08:42:39 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" returned: 0 in 0.267s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-quobyte-f4fbe7e6-c83f-4b45-84eb-ee80b3721634" released by "delete_volume" :: held 0.776s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Created reservations ['5e949e71-1223-486a-960d-f50afb2513dd', 'a2f6864f-c687-40c9-bb03-2fee100317d7', 'a8eb18da-cd3a-4cc2-8ba0-c2a9209d2e02', 'a93c402d-57f2-454a-b0d7-1fa3cb467935'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:39 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:39 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:39 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:39 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d Nov 05 08:42:39 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-d4e1fbad-47c9-4471-b59d-07596f4b3b1d" released by "delete_volume" :: held 0.784s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Deleted volume successfully. Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c3cf0bd5-42ce-4a1c-bb6e-e526cc013787 tempest-CreateVolumesFromSnapshotTest-1504380985 None] Lock "cinder-f4fbe7e6-c83f-4b45-84eb-ee80b3721634-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Created reservations ['20aa3f92-deac-4148-b540-9632633c5245', '3f50a211-8d75-4ba7-a86a-d1960ee416c5', '71d86d68-f3bf-4b12-a29b-6cac272266e0', 'b9237b55-bd6d-42a2-9dc4-2c89342075c4'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Creating offline snapshot 85c0d693-a739-4e44-bbd0-7681a711f87c of volume e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2748364-4eee-4f41-8558-25ad7eece8bd]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:40 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:40 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 Nov 05 08:42:40 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:40 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "cinder-f0d4abe1-7a19-47c1-b708-936532e178e9-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.360s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:40 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Deleted volume successfully. Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "cinder-f0d4abe1-7a19-47c1-b708-936532e178e9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=236,cinder:UPDATE=323,cinder:DELETE=32,cinder:INSERT=94 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ff946966-8790-48ec-91ba-83a720506166 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-d4e1fbad-47c9-4471-b59d-07596f4b3b1d-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=332,cinder:SELECT=250,cinder:INSERT=82,cinder:DELETE=26 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "cinder-quobyte-f0d4abe1-7a19-47c1-b708-936532e178e9" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "cinder-quobyte-f0d4abe1-7a19-47c1-b708-936532e178e9" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7542f46-e884-49c8-8570-59fbc13d0531]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:40 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4" returned: 0 in 0.700s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:40 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c 1G Nov 05 08:42:41 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:41 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 Nov 05 08:42:41 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (640fce2b-8d10-48e5-85b6-987dddc6b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3a0f49-4174-4f48-9dac-e3ae92c54d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3a0f49-4174-4f48-9dac-e3ae92c54d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461542970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76134f11-3fea-4068-b60c-cfe45bf7690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:41Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe0ecbf-0fd8-42e4-8fa6-158850f374f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe0ecbf-0fd8-42e4-8fa6-158850f374f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374acc7b-f1ab-42c5-8090-11fe55ff1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374acc7b-f1ab-42c5-8090-11fe55ff1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76134f11-3fea-4068-b60c-cfe45bf7690d', 'volume_name': 'volume-76134f11-3fea-4068-b60c-cfe45bf7690d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ff849-d753-4430-ba77-6267d2cd779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ff849-d753-4430-ba77-6267d2cd779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860bfae9-87f6-46d8-98b9-e51b7230f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:41 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Volume 76134f11-3fea-4068-b60c-cfe45bf7690d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76134f11-3fea-4068-b60c-cfe45bf7690d', 'volume_size': 1} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:41 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9" returned: 0 in 0.501s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9 Nov 05 08:42:41 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c 1G" returned: 0 in 0.513s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c Nov 05 08:42:41 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-f0d4abe1-7a19-47c1-b708-936532e178e9" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "cinder-quobyte-f0d4abe1-7a19-47c1-b708-936532e178e9" released by "delete_volume" :: held 0.846s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Created reservations ['e80d5809-6420-4f61-bcc7-5630921baf8e', '0db6e721-61be-41d9-bbe9-06f03ccce386', '4b2e1885-d922-40c5-959a-c62956a56bab', '69d3c24f-4027-4481-b734-a69812368622'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c" returned: 0 in 0.366s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:41 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c is being set with open permissions: ugo+rw Nov 05 08:42:41 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:41 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:41 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:41 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c Nov 05 08:42:41 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:42 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Deleted volume successfully. Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a2ae8729-b016-4821-bf6e-c93ee52bf392 tempest-ProjectReaderTests-2145452193 None] Lock "cinder-f0d4abe1-7a19-47c1-b708-936532e178e9-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info Nov 05 08:42:42 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Flow 'volume_create_manager' (2cd78a3b-6419-4075-9580-1e2f322d05d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2406e75-40dc-4ddb-ad52-7123d1be1b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:42 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info is being set with open permissions: ugo+rw Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2406e75-40dc-4ddb-ad52-7123d1be1b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723043644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d271b-9219-49ec-a994-db511ece2469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57e190cf964c5c8963917f1f02ea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:42Z,use_quota=True,user_id='5f9efaa91c39432a9497f7a449d2be45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:42 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info Nov 05 08:42:42 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3678188-59de-492e-88dc-5ed599ae3610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3678188-59de-492e-88dc-5ed599ae3610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0882df6d-d2a4-454a-b08c-588bfe4dcc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0882df6d-d2a4-454a-b08c-588bfe4dcc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5d271b-9219-49ec-a994-db511ece2469', 'volume_name': 'volume-1c5d271b-9219-49ec-a994-db511ece2469', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413f7a08-ac55-4ed3-8601-1e58aa694903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413f7a08-ac55-4ed3-8601-1e58aa694903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2336e8f2-062a-4424-a6c6-d397a16470b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Volume 1c5d271b-9219-49ec-a994-db511ece2469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5d271b-9219-49ec-a994-db511ece2469', 'volume_size': 1} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:42 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.info" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461542970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76134f11-3fea-4068-b60c-cfe45bf7690d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:41Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Creating volume 76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:42 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d 1073741824 Nov 05 08:42:42 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:42 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c45dde95-6a8a-42fa-b859-039602dbcc6a tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:42:43 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d 1073741824" returned: 0 in 0.459s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d Nov 05 08:42:43 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-85c0d693-a739-4e44-bbd0-7681a711f87c-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-85c0d693-a739-4e44-bbd0-7681a711f87c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-85c0d693-a739-4e44-bbd0-7681a711f87c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-85c0d693-a739-4e44-bbd0-7681a711f87c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot 85c0d693-a739-4e44-bbd0-7681a711f87c of volume e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2c7bba-e222-427b-bbc4-1170a226cd09]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Flow 'volume_create_manager' (9b3e4939-40d8-4a1d-b480-03b9833b3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d7177f-9378-4281-822a-550866da1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c Nov 05 08:42:43 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d7177f-9378-4281-822a-550866da1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0734a390-34e3-4ded-8b4d-18be104d014b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e7918208f4458bef50d58fd5666ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:44Z,use_quota=True,user_id='4d8da33ba7c14942a7fc0c9523bba4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd3903c-0885-4fa0-9674-cf556ee35e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd3903c-0885-4fa0-9674-cf556ee35e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c53960d-0788-4cd6-85ec-78c983d8a988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c53960d-0788-4cd6-85ec-78c983d8a988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0734a390-34e3-4ded-8b4d-18be104d014b', 'volume_name': 'volume-0734a390-34e3-4ded-8b4d-18be104d014b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c512c5-cd05-4500-804e-e1f547794916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c512c5-cd05-4500-804e-e1f547794916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec97c0a4-d672-4dec-9daa-a062d4a70b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Volume 0734a390-34e3-4ded-8b4d-18be104d014b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0734a390-34e3-4ded-8b4d-18be104d014b', 'volume_size': 1} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d" returned: 0 in 0.385s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1723043644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d271b-9219-49ec-a994-db511ece2469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57e190cf964c5c8963917f1f02ea05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:42Z,use_quota=True,user_id='5f9efaa91c39432a9497f7a449d2be45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Creating volume 1c5d271b-9219-49ec-a994-db511ece2469 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:43 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:43 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 1073741824 Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860bfae9-87f6-46d8-98b9-e51b7230f105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76134f11-3fea-4068-b60c-cfe45bf7690d', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a7e7c-c32c-4bcb-8032-dd1ec46a1681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Volume volume-76134f11-3fea-4068-b60c-cfe45bf7690d (76134f11-3fea-4068-b60c-cfe45bf7690d): created successfully Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a7e7c-c32c-4bcb-8032-dd1ec46a1681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (640fce2b-8d10-48e5-85b6-987dddc6b83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3a276573-c16d-4793-8c5c-ca3ea41d93a7 tempest-ProjectReaderTests-1788288151 None] Created volume successfully. Nov 05 08:42:43 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c" returned: 0 in 0.384s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc11417-8731-40a6-9820-0686a7bf5c5c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 Nov 05 08:42:44 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 1073741824" returned: 0 in 0.514s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 Nov 05 08:42:44 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:44 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4" returned: 0 in 0.429s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c Nov 05 08:42:44 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469" returned: 0 in 0.290s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0734a390-34e3-4ded-8b4d-18be104d014b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e7918208f4458bef50d58fd5666ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:44Z,use_quota=True,user_id='4d8da33ba7c14942a7fc0c9523bba4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Creating volume 0734a390-34e3-4ded-8b4d-18be104d014b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:44 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b 1073741824 Nov 05 08:42:44 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2336e8f2-062a-4424-a6c6-d397a16470b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5d271b-9219-49ec-a994-db511ece2469', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e73c7c-77ad-40dc-8f24-d6b3e2b8d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:44 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Volume volume-1c5d271b-9219-49ec-a994-db511ece2469 (1c5d271b-9219-49ec-a994-db511ece2469): created successfully Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e73c7c-77ad-40dc-8f24-d6b3e2b8d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Flow 'volume_create_manager' (2cd78a3b-6419-4075-9580-1e2f322d05d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-274aa19f-5380-4714-83b2-19db762e8f88 tempest-ProjectReaderTests-2145452193 None] Created volume successfully. Nov 05 08:42:44 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c" returned: 0 in 0.368s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:44 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c Nov 05 08:42:44 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4.85c0d693-a739-4e44-bbd0-7681a711f87c" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b 1073741824" returned: 0 in 0.463s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-85c0d693-a739-4e44-bbd0-7681a711f87c" released by "_delete_snapshot" :: held 1.572s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" released by "delete_snapshot" :: held 1.596s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b Nov 05 08:42:45 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Created reservations ['5ac7d11a-a5ae-415f-bc87-a09460555a19', 'ffb47d28-3384-41b2-a22a-dc22297587d3', '9d8f0286-bdfc-4cf0-a31d-d4da76e4a574', '35b866b9-1bed-42c2-9649-20d320d23f92'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-82a99991-b0ee-4a51-bc52-84a7e0fb304f tempest-ProjectMemberTests-78095360 None] Lock "cinder-85c0d693-a739-4e44-bbd0-7681a711f87c-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:45 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec97c0a4-d672-4dec-9daa-a062d4a70b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0734a390-34e3-4ded-8b4d-18be104d014b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5a9a2f-0637-4285-8f18-61c4e402e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Creating offline snapshot 7e92a40b-9543-4e39-a28c-9dd74599ebe9 of volume 76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Volume volume-0734a390-34e3-4ded-8b4d-18be104d014b (0734a390-34e3-4ded-8b4d-18be104d014b): created successfully Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5a9a2f-0637-4285-8f18-61c4e402e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Flow 'volume_create_manager' (9b3e4939-40d8-4a1d-b480-03b9833b3e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935ad0a-dab9-417b-be65-d3e76e5b2901]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f095b374-af67-4f9b-a397-6f723603eb40 tempest-CinderUnicodeTest-2070421856 None] Created volume successfully. Nov 05 08:42:45 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d Nov 05 08:42:45 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-e04d4416-3268-44c7-8e94-c1a6a7d727f4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "cinder-e04d4416-3268-44c7-8e94-c1a6a7d727f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" acquired by "delete_volume" :: waited 0.029s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Acquiring lock "cinder-1c5d271b-9219-49ec-a994-db511ece2469-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c28534-af92-47da-98d1-ec9bce324cec]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "cinder-1c5d271b-9219-49ec-a994-db511ece2469-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:45 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 1G Nov 05 08:42:45 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Acquiring lock "cinder-quobyte-1c5d271b-9219-49ec-a994-db511ece2469" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "cinder-quobyte-1c5d271b-9219-49ec-a994-db511ece2469" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:45 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 Nov 05 08:42:45 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c7ca7-ce9a-4be1-91f7-20a9beee5466]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 Nov 05 08:42:46 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4" returned: 0 in 0.485s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4 Nov 05 08:42:46 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 1G" returned: 0 in 0.516s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Flow 'volume_create_manager' (5386e33f-080e-40f5-88c9-e9cb05907a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5a0a4f-e291-4439-bf44-3e9688cf78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76134f11-3fea-4068-b60c-cfe45bf7690d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76134f11-3fea-4068-b60c-cfe45bf7690d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 Nov 05 08:42:46 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5a0a4f-e291-4439-bf44-3e9688cf78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-493496474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9401ba-02b5-4338-ac51-436c75663be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e7918208f4458bef50d58fd5666ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:46Z,use_quota=True,user_id='4d8da33ba7c14942a7fc0c9523bba4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d48d3cd-e724-4ec4-a7d6-021b82ac4073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d48d3cd-e724-4ec4-a7d6-021b82ac4073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13189ac6-bb5c-4116-bf57-04d25e6f0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:46 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13189ac6-bb5c-4116-bf57-04d25e6f0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9401ba-02b5-4338-ac51-436c75663be8', 'volume_name': 'volume-2e9401ba-02b5-4338-ac51-436c75663be8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e04ff4-34be-4e48-baed-39b43d76f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e04ff4-34be-4e48-baed-39b43d76f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405aa122-4569-4bda-95c4-df11cb65f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Volume 2e9401ba-02b5-4338-ac51-436c75663be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9401ba-02b5-4338-ac51-436c75663be8', 'volume_size': 1} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469" returned: 0 in 0.499s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469 Nov 05 08:42:46 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e04d4416-3268-44c7-8e94-c1a6a7d727f4" returned: 0 in 0.309s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-e04d4416-3268-44c7-8e94-c1a6a7d727f4" released by "delete_volume" :: held 0.880s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Created reservations ['86e31aeb-a323-44de-b027-a91d18aa23ee', '19172901-32bd-402a-9155-9ca5db28a1cf', '11dd4865-3b7c-4880-b7d2-e38707775548', 'f3c1b961-f02d-4081-892e-c26524142a3a'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:46 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76134f11-3fea-4068-b60c-cfe45bf7690d -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 is being set with open permissions: ugo+rw Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:46 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:46 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c5d271b-9219-49ec-a994-db511ece2469" returned: 0 in 0.295s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:46 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:46 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "cinder-quobyte-1c5d271b-9219-49ec-a994-db511ece2469" released by "delete_volume" :: held 0.875s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Created reservations ['0f1e38ad-dbeb-477d-a7e6-7d786520c68c', '7ae84ebf-b1f5-4f12-891c-c1e995809d98', '4c26e63f-9ed8-49d7-9898-0ac5bf8d5741', 'e0bb8b42-fa73-49b2-b4af-ff78a3b0ea94'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:47 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.327s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info Nov 05 08:42:47 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a3c3f617-f240-4299-89f5-b72bf0fc8339 tempest-ProjectMemberTests-78095360 None] Lock "cinder-e04d4416-3268-44c7-8e94-c1a6a7d727f4-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:47 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.482s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Deleted volume successfully. Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (ac718f2b-def9-4a8a-b972-da6f89e31db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:47 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562c0146-2c15-421c-b783-82fc9f9f4b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info is being set with open permissions: ugo+rw Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info Nov 05 08:42:47 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562c0146-2c15-421c-b783-82fc9f9f4b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871695050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96fd656-49d8-4d25-a338-7fcd6c058f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:47Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb35ab-a49b-4aa0-9598-82c3479e9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb35ab-a49b-4aa0-9598-82c3479e9da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ecf1e-98b3-45e8-9344-362660e53cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ecf1e-98b3-45e8-9344-362660e53cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96fd656-49d8-4d25-a338-7fcd6c058f6b', 'volume_name': 'volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd366147-ae5f-4ae0-a5bc-beba56e95cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd366147-ae5f-4ae0-a5bc-beba56e95cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3515871e-ef15-437f-9b5e-f99debeecca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:47 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Volume c96fd656-49d8-4d25-a338-7fcd6c058f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b', 'volume_size': 1} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a1855dab-c8d6-44c9-9e8b-f40652a009fa tempest-ProjectReaderTests-2145452193 None] Lock "cinder-1c5d271b-9219-49ec-a994-db511ece2469-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:47 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.info" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-493496474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9401ba-02b5-4338-ac51-436c75663be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='595e7918208f4458bef50d58fd5666ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:46Z,use_quota=True,user_id='4d8da33ba7c14942a7fc0c9523bba4c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Creating volume 2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:47 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:47 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 1073741824 Nov 05 08:42:47 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:47 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-550235d4-79ca-4514-9372-b297d911c3f5 tempest-ProjectReaderTests-1788288151 None] Create snapshot completed successfully Nov 05 08:42:48 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 1073741824" returned: 0 in 0.491s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:48 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 Nov 05 08:42:48 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-7e92a40b-9543-4e39-a28c-9dd74599ebe9-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:48 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-7e92a40b-9543-4e39-a28c-9dd74599ebe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871695050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96fd656-49d8-4d25-a338-7fcd6c058f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:47Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Creating volume c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:48 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:48 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b 1073741824 Nov 05 08:42:48 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405aa122-4569-4bda-95c4-df11cb65f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9401ba-02b5-4338-ac51-436c75663be8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb7f02-a114-4386-b044-8a3d776fe67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-7e92a40b-9543-4e39-a28c-9dd74599ebe9" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:48 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Volume volume-2e9401ba-02b5-4338-ac51-436c75663be8 (2e9401ba-02b5-4338-ac51-436c75663be8): created successfully Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cb7f02-a114-4386-b044-8a3d776fe67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Flow 'volume_create_manager' (5386e33f-080e-40f5-88c9-e9cb05907a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-7e92a40b-9543-4e39-a28c-9dd74599ebe9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Deleting offline snapshot 7e92a40b-9543-4e39-a28c-9dd74599ebe9 of volume 76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] snapshot_file for this snap is: volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[639eb2a1-7568-4ae1-b2d9-9289bf85febb]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9ee33340-4f55-42e3-b6c1-c79fd5f236d3 tempest-CinderUnicodeTest-2070421856 None] Created volume successfully. Nov 05 08:42:48 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 Nov 05 08:42:48 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b 1073741824" returned: 0 in 0.487s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b Nov 05 08:42:49 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9" returned: 0 in 0.418s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76134f11-3fea-4068-b60c-cfe45bf7690d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[74acafd1-d921-45b7-9d44-ee1176810128]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d Nov 05 08:42:49 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b" returned: 0 in 0.254s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3515871e-ef15-437f-9b5e-f99debeecca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367161bf-cd07-455f-aa4b-47d25bc15887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Volume volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b (c96fd656-49d8-4d25-a338-7fcd6c058f6b): created successfully Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367161bf-cd07-455f-aa4b-47d25bc15887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (ac718f2b-def9-4a8a-b972-da6f89e31db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:49 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bee33569-83ae-4b41-8c36-4b8f090d5131 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:42:49 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 Nov 05 08:42:49 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Creating offline snapshot d9ca9443-0b31-484e-84c5-166bba031000 of volume 2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e81d7-50a7-42d0-ab27-0c5aa2698547]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:49 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 Nov 05 08:42:49 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9" returned: 0 in 0.363s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:49 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9 Nov 05 08:42:49 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:50 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d.7e92a40b-9543-4e39-a28c-9dd74599ebe9" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8" returned: 0 in 0.426s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-7e92a40b-9543-4e39-a28c-9dd74599ebe9" released by "_delete_snapshot" :: held 1.578s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" released by "delete_snapshot" :: held 1.626s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:50 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 1G Nov 05 08:42:50 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Created reservations ['92e69b97-2fdd-4c76-9c13-0546460c5780', '39e06ffb-5e86-4d1b-b0da-d7528b566bd4', '09c313f3-761e-439c-aa39-a5079a358151', 'f6b475ed-4cd5-4b31-8811-a6b585311996'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Delete snapshot completed successfully. Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8260b852-403e-4493-86d1-3989108fcac9 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-7e92a40b-9543-4e39-a28c-9dd74599ebe9-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-76134f11-3fea-4068-b60c-cfe45bf7690d-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:50 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 1G" returned: 0 in 0.504s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9401ba-02b5-4338-ac51-436c75663be8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "cinder-76134f11-3fea-4068-b60c-cfe45bf7690d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:50 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9401ba-02b5-4338-ac51-436c75663be8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 Nov 05 08:42:50 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6cc75-b7d0-48fb-976f-3602c6bdb97d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:50 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d Nov 05 08:42:51 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9401ba-02b5-4338-ac51-436c75663be8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000" returned: 0 in 0.321s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 is being set with open permissions: ugo+rw Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 Nov 05 08:42:51 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d" returned: 0 in 0.382s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d Nov 05 08:42:51 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info Nov 05 08:42:51 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-76134f11-3fea-4068-b60c-cfe45bf7690d" returned: 0 in 0.281s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-76134f11-3fea-4068-b60c-cfe45bf7690d" released by "delete_volume" :: held 0.738s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Created reservations ['8eeca7c3-0a74-4e13-a9ce-d8ff8d8e2e37', '05afa206-4ee8-48f6-b91e-8ea349db20a8', 'c357c670-ba6a-4ccf-bd2d-05aaded08d10', 'c076ac3f-0fec-4715-9417-8981c090a845'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:51 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info is being set with open permissions: ugo+rw Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info Nov 05 08:42:51 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:51 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:51 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:51 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.info" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.289s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:51 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Creating offline snapshot 08c8e07c-3c00-46f4-b9fb-ee19770123bd of volume c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Deleted volume successfully. Nov 05 08:42:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e756aece-5c5c-4516-83f3-8f0d18adbafd tempest-CinderUnicodeTest-2070421856 None] Create snapshot completed successfully Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7142cc-2227-4ae0-9814-b5ea0537d6f2]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01334764-b0f6-4424-b9df-b1672964706a tempest-ProjectReaderTests-1788288151 None] Lock "cinder-76134f11-3fea-4068-b60c-cfe45bf7690d-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:52 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b Nov 05 08:42:52 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (395c62ff-f47b-4588-9d6d-84c2884ebd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:52 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a86acce-ae88-4f23-ba61-37881a0ce5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a86acce-ae88-4f23-ba61-37881a0ce5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733238501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5380f6d9-dfaf-428e-96c5-94881ab2f7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:52Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd 1G Nov 05 08:42:52 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580c2802-cf81-4dc3-abd7-0008a9dba005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580c2802-cf81-4dc3-abd7-0008a9dba005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0370e2-f75b-4fdd-8a24-ab70837ad209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0370e2-f75b-4fdd-8a24-ab70837ad209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5380f6d9-dfaf-428e-96c5-94881ab2f7d4', 'volume_name': 'volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbc30ae-2c6c-4bf2-833d-3a911371c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbc30ae-2c6c-4bf2-833d-3a911371c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e1e001-34a8-43a7-b06a-d23f8dcef4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Volume 5380f6d9-dfaf-428e-96c5-94881ab2f7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4', 'volume_size': 1} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:52 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd 1G" returned: 0 in 0.399s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:52 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd Nov 05 08:42:52 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-d9ca9443-0b31-484e-84c5-166bba031000-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-d9ca9443-0b31-484e-84c5-166bba031000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-quobyte-d9ca9443-0b31-484e-84c5-166bba031000" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-d9ca9443-0b31-484e-84c5-166bba031000" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Deleting offline snapshot d9ca9443-0b31-484e-84c5-166bba031000 of volume 2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] snapshot_file for this snap is: volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637f8c6-6c08-4748-89da-8f1e5905e096]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd is being set with open permissions: ugo+rw Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 Nov 05 08:42:53 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd Nov 05 08:42:53 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd" returned: 0 in 0.255s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9401ba-02b5-4338-ac51-436c75663be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:53 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info Nov 05 08:42:53 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af97c6e-8cd4-4d42-8b8b-33abebd4141a]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 Nov 05 08:42:53 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info is being set with open permissions: ugo+rw Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info Nov 05 08:42:53 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:53 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 Nov 05 08:42:53 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:53 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.info" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733238501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5380f6d9-dfaf-428e-96c5-94881ab2f7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:52Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Creating volume 5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:54 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 1073741824 Nov 05 08:42:54 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9732f0f9-0aa9-42c7-82e4-3f277d334b92 tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:42:54 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000" returned: 0 in 0.346s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000 Nov 05 08:42:54 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 1073741824" returned: 0 in 0.464s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8.d9ca9443-0b31-484e-84c5-166bba031000" returned: 0 in 0.271s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-d9ca9443-0b31-484e-84c5-166bba031000" released by "_delete_snapshot" :: held 1.503s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" released by "delete_snapshot" :: held 1.529s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:54 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 Nov 05 08:42:54 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Created reservations ['cacee249-f389-4b12-ad1b-55badb105303', 'ac3a0708-43e2-4196-87e1-84f586e3a2ed', '1208e57a-66c6-40eb-a430-4fdde6f74310', '3da65c05-0a45-40b3-9e5a-afb65dade925'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Delete snapshot completed successfully. Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-cecf3be2-d05a-4961-a3ba-4b4009e9e2f7 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-d9ca9443-0b31-484e-84c5-166bba031000-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:54 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e1e001-34a8-43a7-b06a-d23f8dcef4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1cb746-bd6d-4559-82ce-fab5e9a17f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:54 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Volume volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 (5380f6d9-dfaf-428e-96c5-94881ab2f7d4): created successfully Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1cb746-bd6d-4559-82ce-fab5e9a17f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (395c62ff-f47b-4588-9d6d-84c2884ebd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:54 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1dca08e2-c491-4335-bbdc-82fb048598aa tempest-ProjectReaderTests-1788288151 None] Created volume successfully. Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-08c8e07c-3c00-46f4-b9fb-ee19770123bd-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-08c8e07c-3c00-46f4-b9fb-ee19770123bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-08c8e07c-3c00-46f4-b9fb-ee19770123bd" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-08c8e07c-3c00-46f4-b9fb-ee19770123bd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot 08c8e07c-3c00-46f4-b9fb-ee19770123bd of volume c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f94550-2082-4de7-8f2a-ba6123a2aaaa]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd Nov 05 08:42:55 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-2e9401ba-02b5-4338-ac51-436c75663be8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-2e9401ba-02b5-4338-ac51-436c75663be8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c996d34-51ed-43f5-a785-7f0b3c889326]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:55 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 Nov 05 08:42:55 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eed675-d2c6-45bc-85fe-1caae6da4d25]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b Nov 05 08:42:55 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8" returned: 0 in 0.395s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8 Nov 05 08:42:55 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Creating offline snapshot e0ca60ba-c502-4fab-8b22-2a10c1dbc941 of volume 5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9ce48-15c5-411d-a3f9-d9696d9d8728]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b" returned: 0 in 0.409s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:55 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd Nov 05 08:42:55 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 Nov 05 08:42:55 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:55 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-2e9401ba-02b5-4338-ac51-436c75663be8" returned: 0 in 0.297s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-2e9401ba-02b5-4338-ac51-436c75663be8" released by "delete_volume" :: held 0.762s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Created reservations ['27cbfb35-732b-4b16-a5c7-caa97ac581a6', 'aeab6ce5-e4f1-44c8-bdb8-c6617a339d6f', 'fc5cf7bd-4c22-4aaa-acd0-3b42b87db93d', '0fe3880f-b32c-4637-91f1-41f0d96431ff'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:56 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" returned: 0 in 0.427s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd Nov 05 08:42:56 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 1G Nov 05 08:42:56 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-0734a390-34e3-4ded-8b4d-18be104d014b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-0734a390-34e3-4ded-8b4d-18be104d014b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:56 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "cinder-quobyte-0734a390-34e3-4ded-8b4d-18be104d014b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.331s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Deleted volume successfully. Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-0734a390-34e3-4ded-8b4d-18be104d014b" acquired by "delete_volume" :: waited 0.028s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-a099657c-0935-48fd-98db-c511b1268f57 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-2e9401ba-02b5-4338-ac51-436c75663be8-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cb7ce3-4ec3-44bc-8faf-b9af7ccc7232]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b.08c8e07c-3c00-46f4-b9fb-ee19770123bd" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-08c8e07c-3c00-46f4-b9fb-ee19770123bd" released by "_delete_snapshot" :: held 1.630s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" released by "delete_snapshot" :: held 1.659s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b Nov 05 08:42:56 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Created reservations ['7ba37578-8b4a-416f-8237-cdc186dcc389', 'ff840b79-403a-4467-95c3-c7608b26c2f2', '1165805f-d324-4662-964d-fb8cad658f11', 'a00cab48-3b75-4d81-9855-f8589af746d1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:56 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-fef77324-f830-4e95-9fa7-bf583fe7a548 tempest-ProjectMemberTests-78095360 None] Lock "cinder-08c8e07c-3c00-46f4-b9fb-ee19770123bd-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:56 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 1G" returned: 0 in 0.525s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 Nov 05 08:42:56 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:56 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b" returned: 0 in 0.423s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:56 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:56 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b Nov 05 08:42:56 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-c96fd656-49d8-4d25-a338-7fcd6c058f6b-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:57 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941" returned: 0 in 0.330s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 is being set with open permissions: ugo+rw Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-c96fd656-49d8-4d25-a338-7fcd6c058f6b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:57 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 Nov 05 08:42:57 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f57ab17-6a73-483b-9929-ec0ac65b2644]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-0734a390-34e3-4ded-8b4d-18be104d014b" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-quobyte-0734a390-34e3-4ded-8b4d-18be104d014b" released by "delete_volume" :: held 0.797s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Created reservations ['2a0da902-e383-4142-adf6-c3601c127a1f', 'e4ce45f7-d585-4369-8791-579f4449b2b4', '5df1c553-ff40-416c-91e0-6c27fbc516e1', '673f1a2a-9797-4220-8682-6284c4d0f0f5'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:57 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b Nov 05 08:42:57 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941" returned: 0 in 0.277s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info Nov 05 08:42:57 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:57 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info" returned: 0 in 0.316s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info is being set with open permissions: ugo+rw Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:57 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b Nov 05 08:42:57 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.311s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:57 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info Nov 05 08:42:57 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:57 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Deleted volume successfully. Nov 05 08:42:57 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5b1731d8-3e55-43c5-ae6e-e0968c138e98 tempest-CinderUnicodeTest-2070421856 None] Lock "cinder-0734a390-34e3-4ded-8b4d-18be104d014b-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:57 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c96fd656-49d8-4d25-a338-7fcd6c058f6b" returned: 0 in 0.319s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-c96fd656-49d8-4d25-a338-7fcd6c058f6b" released by "delete_volume" :: held 0.845s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:58 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.info" returned: 0 in 0.314s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-41938db6-6dd0-4a53-81d3-1222bbc78ac6 tempest-ProjectReaderTests-1788288151 None] Create snapshot completed successfully Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Created reservations ['fa165804-84c9-4ce8-87a5-1966e844eefa', 'dbd74cbd-f86a-4bd3-9d18-714a1f15384f', 'a7d09fb0-0898-46a3-8792-87d515fe2cc4', '24b98cc3-fdab-496c-8343-90bea7c11ae7'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:58 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:42:58 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:58 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.310s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:42:58 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9552c2ff-3b18-4070-845d-8ef16363bce6 tempest-ProjectMemberTests-78095360 None] Lock "cinder-c96fd656-49d8-4d25-a338-7fcd6c058f6b-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (e9c168cd-ce80-4b86-90a3-03c5b6fbc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b5e1b7-4c6c-4d81-b5ed-98b0f26a71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b5e1b7-4c6c-4d81-b5ed-98b0f26a71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115150260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36654b2-546f-406b-9aae-d0f94f6bc798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:59Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e660e67d-0146-4cf6-982e-90ae27de18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e660e67d-0146-4cf6-982e-90ae27de18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80bdc40-7b48-438d-831b-f35a4e417727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80bdc40-7b48-438d-831b-f35a4e417727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36654b2-546f-406b-9aae-d0f94f6bc798', 'volume_name': 'volume-d36654b2-546f-406b-9aae-d0f94f6bc798', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e65423-6e52-4229-8eca-5ff82902fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e65423-6e52-4229-8eca-5ff82902fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca00dc-d61e-4d76-9da7-48cbb381b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:58 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Volume d36654b2-546f-406b-9aae-d0f94f6bc798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36654b2-546f-406b-9aae-d0f94f6bc798', 'volume_size': 1} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115150260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36654b2-546f-406b-9aae-d0f94f6bc798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:42:59Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Creating volume d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:42:58 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:42:58 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:58 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 1073741824 Nov 05 08:42:58 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-e0ca60ba-c502-4fab-8b22-2a10c1dbc941-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-e0ca60ba-c502-4fab-8b22-2a10c1dbc941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-e0ca60ba-c502-4fab-8b22-2a10c1dbc941" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-e0ca60ba-c502-4fab-8b22-2a10c1dbc941" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Deleting offline snapshot e0ca60ba-c502-4fab-8b22-2a10c1dbc941 of volume 5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] snapshot_file for this snap is: volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2ca35b-6e09-4c59-b97a-65ba523fefba]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 Nov 05 08:42:59 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 1073741824" returned: 0 in 0.550s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941" returned: 0 in 0.434s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:42:59 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 Nov 05 08:42:59 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4bbe84-5488-43c6-8188-c198f2588f68]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:42:59 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 Nov 05 08:42:59 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:42:59 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca00dc-d61e-4d76-9da7-48cbb381b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36654b2-546f-406b-9aae-d0f94f6bc798', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e210c-81b8-462c-a7e0-389ed1d6c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:42:59 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Volume volume-d36654b2-546f-406b-9aae-d0f94f6bc798 (d36654b2-546f-406b-9aae-d0f94f6bc798): created successfully Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650e210c-81b8-462c-a7e0-389ed1d6c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:42:59 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (e9c168cd-ce80-4b86-90a3-03c5b6fbc59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:42:59 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8bea690f-8c9f-43dc-b499-fbd3ffe0ea76 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:43:00 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" returned: 0 in 0.406s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:00 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 Nov 05 08:43:00 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941" returned: 0 in 0.362s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:00 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941 Nov 05 08:43:00 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:00 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4.e0ca60ba-c502-4fab-8b22-2a10c1dbc941" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-e0ca60ba-c502-4fab-8b22-2a10c1dbc941" released by "_delete_snapshot" :: held 1.593s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" released by "delete_snapshot" :: held 1.621s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Created reservations ['b0254a4f-8404-46fd-9934-3c77477ffc67', '3f6395bf-23fb-4704-9dca-ea19c19634e5', '38957390-792c-40ad-9f4b-a6996bb2d73e', '1efb1d33-f288-476a-9085-0e0303f24808'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:00 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Delete snapshot completed successfully. Nov 05 08:43:00 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-2ff85faa-0adb-4156-b187-37815f5e24a6 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-e0ca60ba-c502-4fab-8b22-2a10c1dbc941-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-e2ba79b6-48e6-444e-913f-e4377db51c21 tempest-ProjectAdminTests-314344889 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5298614501953, 'free_capacity_gb': 1773.5298614501953, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87092) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Creating offline snapshot 40949f05-80e2-40fb-82c7-8eb4f918b7ee of volume d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a52545f-72cc-47d1-b2f0-b42a6a857b35]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-5380f6d9-dfaf-428e-96c5-94881ab2f7d4-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "cinder-5380f6d9-dfaf-428e-96c5-94881ab2f7d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:01 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 Nov 05 08:43:01 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[1974d23b-8d6f-40b7-8274-13d99cd067ee]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 Nov 05 08:43:01 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798" returned: 0 in 0.455s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee 1G Nov 05 08:43:01 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:01 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" returned: 0 in 0.411s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:01 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:01 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4 Nov 05 08:43:01 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee 1G" returned: 0 in 0.445s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36654b2-546f-406b-9aae-d0f94f6bc798 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-5380f6d9-dfaf-428e-96c5-94881ab2f7d4" released by "delete_volume" :: held 0.794s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:02 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36654b2-546f-406b-9aae-d0f94f6bc798 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee Nov 05 08:43:02 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Created reservations ['6cba9497-b754-4069-bcfe-1abcab310276', '9c383aec-bff8-4e7f-bdea-de95790d5d17', '0cc80926-34a3-4a5d-851e-1e2a1a4a0b6a', 'e488db8c-badb-4f8d-addc-38617f91671b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:02 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36654b2-546f-406b-9aae-d0f94f6bc798 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee" returned: 0 in 0.416s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee is being set with open permissions: ugo+rw Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee Nov 05 08:43:02 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.317s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:02 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Deleted volume successfully. Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-401b4c00-fab8-4926-8b05-6bdf459803fc tempest-ProjectReaderTests-1788288151 None] Lock "cinder-5380f6d9-dfaf-428e-96c5-94881ab2f7d4-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:02 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee" returned: 0 in 0.327s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:02 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info Nov 05 08:43:02 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (036d3125-2d0c-4d4d-bc9f-cc433082bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cc3bd7-2715-4f51-97c4-1a84176dbfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cc3bd7-2715-4f51-97c4-1a84176dbfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781649171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c747735-48b2-4d3d-a825-744aff7fbcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:03Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9479319-8d99-4b2b-891c-0e632a659c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9479319-8d99-4b2b-891c-0e632a659c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566bb13c-21ae-41d3-9027-87ee9898890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566bb13c-21ae-41d3-9027-87ee9898890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c747735-48b2-4d3d-a825-744aff7fbcf2', 'volume_name': 'volume-1c747735-48b2-4d3d-a825-744aff7fbcf2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b0981a-e683-41e4-a08e-2c11bd6bab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b0981a-e683-41e4-a08e-2c11bd6bab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bbf866-f66c-4c0d-bb61-891677826a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Volume 1c747735-48b2-4d3d-a825-744aff7fbcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c747735-48b2-4d3d-a825-744aff7fbcf2', 'volume_size': 1} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:03 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info" returned: 0 in 0.308s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info is being set with open permissions: ugo+rw Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:03 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info Nov 05 08:43:03 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:03 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.info" returned: 0 in 0.269s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781649171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c747735-48b2-4d3d-a825-744aff7fbcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:03Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Creating volume 1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:03 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:03 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 1073741824 Nov 05 08:43:03 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-6a90114f-e568-400f-80fb-ad66f3cfef80 tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:43:03 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 1073741824" returned: 0 in 0.465s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:03 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 Nov 05 08:43:03 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bbf866-f66c-4c0d-bb61-891677826a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c747735-48b2-4d3d-a825-744aff7fbcf2', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bac856-9c66-4cfa-bb6e-b47b4fae99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:04 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Volume volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 (1c747735-48b2-4d3d-a825-744aff7fbcf2): created successfully Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bac856-9c66-4cfa-bb6e-b47b4fae99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (036d3125-2d0c-4d4d-bc9f-cc433082bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:04 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7932bf56-ad89-4347-a89d-dc9329851bd9 tempest-ProjectReaderTests-1788288151 None] Created volume successfully. Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-40949f05-80e2-40fb-82c7-8eb4f918b7ee-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-40949f05-80e2-40fb-82c7-8eb4f918b7ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-40949f05-80e2-40fb-82c7-8eb4f918b7ee" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-40949f05-80e2-40fb-82c7-8eb4f918b7ee" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot 40949f05-80e2-40fb-82c7-8eb4f918b7ee of volume d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f60af-a4d4-447b-9339-5f7df78004c9]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee Nov 05 08:43:04 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:04 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee" returned: 0 in 0.387s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36654b2-546f-406b-9aae-d0f94f6bc798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b4a26-1660-41a6-a81a-4b8e13780b6e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:04 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 Nov 05 08:43:04 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Creating offline snapshot 561537d7-34a7-4b05-a274-ed2a89d1a8da of volume 1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f646d3-9b93-4604-abbf-861225c16095]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798" returned: 0 in 0.424s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee Nov 05 08:43:05 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 Nov 05 08:43:05 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:05 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee Nov 05 08:43:05 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da 1G Nov 05 08:43:05 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:05 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798.40949f05-80e2-40fb-82c7-8eb4f918b7ee" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-40949f05-80e2-40fb-82c7-8eb4f918b7ee" released by "_delete_snapshot" :: held 1.537s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" released by "delete_snapshot" :: held 1.560s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:05 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Created reservations ['fe566dc2-a316-4b2e-b30f-a75566ad47e5', '42fbd37a-bec5-4d24-8f64-40a734f1060a', '0b3894c9-acbd-438f-8c5b-5f5eb02bdbca', '56d1e2a5-e31a-4684-b7df-ecbb0d5daf6d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:06 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-e797d3f6-8c57-4660-b0e3-ba9bbe0334d9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-40949f05-80e2-40fb-82c7-8eb4f918b7ee-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:06 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da 1G" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da Nov 05 08:43:06 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da" returned: 0 in 0.286s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da is being set with open permissions: ugo+rw Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da Nov 05 08:43:06 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-d36654b2-546f-406b-9aae-d0f94f6bc798-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "cinder-d36654b2-546f-406b-9aae-d0f94f6bc798-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" acquired by "delete_volume" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:06 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da" returned: 0 in 0.282s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22f1962-ddc4-4829-9d3f-ee5a5fae5935]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info Nov 05 08:43:06 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 Nov 05 08:43:06 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:06 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info" returned: 0 in 0.303s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:06 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info is being set with open permissions: ugo+rw Nov 05 08:43:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:06 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info Nov 05 08:43:06 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:07 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:07 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798 Nov 05 08:43:07 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:07 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.info" returned: 0 in 0.289s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-3c75b3e8-848e-4538-b315-6d3ded942ab2 tempest-ProjectReaderTests-1788288151 None] Create snapshot completed successfully Nov 05 08:43:07 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-d36654b2-546f-406b-9aae-d0f94f6bc798" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-d36654b2-546f-406b-9aae-d0f94f6bc798" released by "delete_volume" :: held 0.787s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Created reservations ['313564c8-bb91-4068-9642-aa033963977f', '04484628-5164-4859-8561-9641f2fd4e55', 'd6616644-bdf1-4809-b510-f7eba3c1b20d', 'c49af9b2-7479-4095-9cb5-c03998efc103'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:07 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:07 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:07 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:07 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:43:07 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-89d324d1-b90d-4003-a91e-4fbba6e5b276 tempest-ProjectMemberTests-78095360 None] Lock "cinder-d36654b2-546f-406b-9aae-d0f94f6bc798-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (c661d215-333f-49d5-970d-e17474cb84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9591c23-89ec-46a5-ba88-f861f2f0ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9591c23-89ec-46a5-ba88-f861f2f0ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139107303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46aba67a-c088-4b75-afb0-b58f1c6d0a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:08Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2321efe-64e2-49a7-ae17-4ac3d099cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2321efe-64e2-49a7-ae17-4ac3d099cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21b648-ee75-4d21-ad7d-7aa2336c533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21b648-ee75-4d21-ad7d-7aa2336c533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46aba67a-c088-4b75-afb0-b58f1c6d0a75', 'volume_name': 'volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6fae50-92ea-4e50-bc04-3fc8c2d11bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6fae50-92ea-4e50-bc04-3fc8c2d11bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036aec04-217a-4c7c-a794-9da891aaec52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:08 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Volume 46aba67a-c088-4b75-afb0-b58f1c6d0a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75', 'volume_size': 1} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139107303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46aba67a-c088-4b75-afb0-b58f1c6d0a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:08Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Creating volume 46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:08 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 1073741824 Nov 05 08:43:08 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-561537d7-34a7-4b05-a274-ed2a89d1a8da-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-561537d7-34a7-4b05-a274-ed2a89d1a8da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-561537d7-34a7-4b05-a274-ed2a89d1a8da" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-561537d7-34a7-4b05-a274-ed2a89d1a8da" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Deleting offline snapshot 561537d7-34a7-4b05-a274-ed2a89d1a8da of volume 1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] snapshot_file for this snap is: volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da3844-00af-445f-9bd9-cc31deaed248]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da Nov 05 08:43:08 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:08 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 1073741824" returned: 0 in 0.513s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 Nov 05 08:43:08 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:08 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da" returned: 0 in 0.417s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c747735-48b2-4d3d-a825-744aff7fbcf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d5697-8bbb-4149-ab07-7e1065ca2e7d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:08 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75" returned: 0 in 0.274s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:08 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:08 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:08 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036aec04-217a-4c7c-a794-9da891aaec52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678257ed-045a-4ea0-9d53-a59f93b04d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:09 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Volume volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 (46aba67a-c088-4b75-afb0-b58f1c6d0a75): created successfully Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678257ed-045a-4ea0-9d53-a59f93b04d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (c661d215-333f-49d5-970d-e17474cb84be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:09 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-231e1ed7-ff81-42d3-b90c-2e14e6ff38b8 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:43:09 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:09 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da Nov 05 08:43:09 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da" returned: 0 in 0.347s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:09 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da Nov 05 08:43:09 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:09 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2.561537d7-34a7-4b05-a274-ed2a89d1a8da" returned: 0 in 0.236s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-561537d7-34a7-4b05-a274-ed2a89d1a8da" released by "_delete_snapshot" :: held 1.547s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" released by "delete_snapshot" :: held 1.568s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:09 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Created reservations ['add89928-cba6-48f1-afdf-8ac15be9bbef', 'c618b7be-371c-47b6-9b3b-f813ba588b73', 'be4d7265-55e8-4d53-8e8a-5333d9d5b88d', '183d2fac-49bb-405b-99a3-4340f416030c'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:10 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Delete snapshot completed successfully. Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-9a56a2a2-5e01-4245-a18f-fa85d004ab62 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-561537d7-34a7-4b05-a274-ed2a89d1a8da-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Creating offline snapshot f25f572f-86aa-492b-9b02-4821d6ba1218 of volume 46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[171263a5-04cf-4116-9199-c6f463b00dea]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:10 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 Nov 05 08:43:10 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-1c747735-48b2-4d3d-a825-744aff7fbcf2-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "cinder-1c747735-48b2-4d3d-a825-744aff7fbcf2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" acquired by "delete_volume" :: waited 0.026s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61b853b-ee33-47a8-8623-2df0b292da08]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:10 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:10 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 Nov 05 08:43:10 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75" returned: 0 in 0.476s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:10 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:10 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 1G Nov 05 08:43:10 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2" returned: 0 in 0.434s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2 Nov 05 08:43:11 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 1G" returned: 0 in 0.511s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 Nov 05 08:43:11 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1c747735-48b2-4d3d-a825-744aff7fbcf2" returned: 0 in 0.299s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-1c747735-48b2-4d3d-a825-744aff7fbcf2" released by "delete_volume" :: held 0.820s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Created reservations ['95211286-9b4a-4630-894c-1c0d87bc8f57', '1bf02d7c-5e63-4af2-a98c-5afdfa33012c', 'ee0d1056-b9c2-4f4d-974c-3b0d3cd8ab2d', '185ac93b-13b6-4f7b-8180-ff81af3ac092'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:11 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218" returned: 0 in 0.380s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 is being set with open permissions: ugo+rw Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:11 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 Nov 05 08:43:11 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:11 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.288s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:11 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Deleted volume successfully. Nov 05 08:43:11 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5046cf1a-a635-4076-adaf-7213dda4b6bb tempest-ProjectReaderTests-1788288151 None] Lock "cinder-1c747735-48b2-4d3d-a825-744aff7fbcf2-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:12 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:12 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info Nov 05 08:43:12 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (ee6d4479-809c-40bd-89e4-9a8d0327f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664ed097-00ab-48e5-b3d4-124a6578361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664ed097-00ab-48e5-b3d4-124a6578361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870484965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add5d7b4-ba36-4d2e-bbda-099b7d0e13a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:12Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47622c-8259-4a23-9363-93b82674597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47622c-8259-4a23-9363-93b82674597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6568af8e-dcbe-42bc-9742-0bbc90b131ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6568af8e-dcbe-42bc-9742-0bbc90b131ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add5d7b4-ba36-4d2e-bbda-099b7d0e13a8', 'volume_name': 'volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85734d2-d1e3-46e2-87fa-67f6b3a9c161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85734d2-d1e3-46e2-87fa-67f6b3a9c161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1114e0-0fc4-4987-84d9-197d1b3d84b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:12 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Volume add5d7b4-ba36-4d2e-bbda-099b7d0e13a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8', 'volume_size': 1} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:12 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info is being set with open permissions: ugo+rw Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:12 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info Nov 05 08:43:12 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:12 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.info" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870484965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add5d7b4-ba36-4d2e-bbda-099b7d0e13a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c03eeec47134905b766d6d3dce48d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:12Z,use_quota=True,user_id='1eee4bfcf2164823ab17b0c9f4c2bd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Creating volume add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:12 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:12 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:12 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 1073741824 Nov 05 08:43:12 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:12 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-81e352b3-1076-4a58-839a-867703a5cefd tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:43:13 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 1073741824" returned: 0 in 0.452s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:13 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 Nov 05 08:43:13 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:13 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1114e0-0fc4-4987-84d9-197d1b3d84b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9658358-ba05-4860-9981-baf55412190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Volume volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 (add5d7b4-ba36-4d2e-bbda-099b7d0e13a8): created successfully Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9658358-ba05-4860-9981-baf55412190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Flow 'volume_create_manager' (ee6d4479-809c-40bd-89e4-9a8d0327f63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-f25f572f-86aa-492b-9b02-4821d6ba1218-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-52b7ff0d-df1b-4519-8823-b3d7188e09e1 tempest-ProjectReaderTests-1788288151 None] Created volume successfully. Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-f25f572f-86aa-492b-9b02-4821d6ba1218-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-f25f572f-86aa-492b-9b02-4821d6ba1218" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-f25f572f-86aa-492b-9b02-4821d6ba1218" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot f25f572f-86aa-492b-9b02-4821d6ba1218 of volume 46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17be6de-7deb-44bb-b469-d4fa84fff7ff]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:13 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 Nov 05 08:43:13 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:13 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d5ae46-0fe9-4712-a3fd-258b5873949d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:14 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 Nov 05 08:43:14 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:14 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:14 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 Nov 05 08:43:14 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Creating offline snapshot c76f8e70-356a-4e2d-b49c-6523088dce1c of volume add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73831d6-7584-4f91-bb35-3bd0c381da8d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:14 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 Nov 05 08:43:14 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:14 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218" returned: 0 in 0.390s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:14 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218 Nov 05 08:43:14 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" returned: 0 in 0.428s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c 1G Nov 05 08:43:15 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75.f25f572f-86aa-492b-9b02-4821d6ba1218" returned: 0 in 0.275s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-f25f572f-86aa-492b-9b02-4821d6ba1218" released by "_delete_snapshot" :: held 1.582s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" released by "delete_snapshot" :: held 1.608s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Created reservations ['b68b451e-245d-4b7a-84ff-f34baaf3723a', 'e2f42615-b3f7-4d10-be30-22b11736c79c', '53c39bde-4bdb-4328-9c5a-4d33d77504eb', '96db1270-be0a-451b-8e4e-9ce1317f6b4f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-0305b3bf-1866-466d-b76c-8b9e27bd5f98 tempest-ProjectMemberTests-78095360 None] Lock "cinder-f25f572f-86aa-492b-9b02-4821d6ba1218-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:15 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c 1G" returned: 0 in 0.495s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c Nov 05 08:43:15 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-46aba67a-c088-4b75-afb0-b58f1c6d0a75-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "cinder-46aba67a-c088-4b75-afb0-b58f1c6d0a75-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" acquired by "delete_volume" :: waited 0.024s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c978c5-8c75-4f64-baea-ba1e676b1cda]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c" returned: 0 in 0.346s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:15 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c is being set with open permissions: ugo+rw Nov 05 08:43:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:15 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c Nov 05 08:43:15 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:15 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 Nov 05 08:43:15 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c" returned: 0 in 0.279s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75" returned: 0 in 0.401s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info Nov 05 08:43:16 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75 Nov 05 08:43:16 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info" returned: 0 in 0.287s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info is being set with open permissions: ugo+rw Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-46aba67a-c088-4b75-afb0-b58f1c6d0a75" returned: 0 in 0.285s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info Nov 05 08:43:16 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-46aba67a-c088-4b75-afb0-b58f1c6d0a75" released by "delete_volume" :: held 0.764s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Created reservations ['f3853c9b-7fd3-4798-bb15-c88b37f6666c', 'c5f293f5-faa1-4a03-ae7b-eecb8cac1469', '9b5f7ab8-5960-4219-a191-1109667529ac', '317a2a32-3b1e-4b2f-8dfb-dc9682a73a58'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:16 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:16 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:16 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.info" returned: 0 in 0.272s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-4eef6d32-f037-455e-9305-f78120d6f6d9 tempest-ProjectReaderTests-1788288151 None] Create snapshot completed successfully Nov 05 08:43:16 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.291s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:16 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:16 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-8b15f082-bc96-4d39-841f-c69874cab5ea tempest-ProjectMemberTests-78095360 None] Lock "cinder-46aba67a-c088-4b75-afb0-b58f1c6d0a75-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (a6a3fb87-94f4-4673-a1cf-125bfe822058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bededf1-ebba-43a0-bf16-195b5dbbef82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bededf1-ebba-43a0-bf16-195b5dbbef82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557431047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3227f297-c92d-405f-a5af-277bbd122407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:17Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd68bad-a376-431d-bdb1-1ac472b91565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd68bad-a376-431d-bdb1-1ac472b91565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecde94a-8c86-44b3-a765-c00d381bb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecde94a-8c86-44b3-a765-c00d381bb994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3227f297-c92d-405f-a5af-277bbd122407', 'volume_name': 'volume-3227f297-c92d-405f-a5af-277bbd122407', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55313d8d-62ce-4589-9b7b-e3dfe4e6ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55313d8d-62ce-4589-9b7b-e3dfe4e6ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ddd2c-57eb-43a0-af12-5a57518281fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:17 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Volume 3227f297-c92d-405f-a5af-277bbd122407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3227f297-c92d-405f-a5af-277bbd122407', 'volume_size': 1} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557431047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3227f297-c92d-405f-a5af-277bbd122407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:17Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Creating volume 3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:17 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 1073741824 Nov 05 08:43:17 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-c76f8e70-356a-4e2d-b49c-6523088dce1c-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-c76f8e70-356a-4e2d-b49c-6523088dce1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-c76f8e70-356a-4e2d-b49c-6523088dce1c" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-c76f8e70-356a-4e2d-b49c-6523088dce1c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Deleting offline snapshot c76f8e70-356a-4e2d-b49c-6523088dce1c of volume add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] snapshot_file for this snap is: volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b1bef-4443-45c2-8961-08400ccf5217]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:17 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 1073741824" returned: 0 in 0.481s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:17 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c Nov 05 08:43:17 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 Nov 05 08:43:18 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:18 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407" returned: 0 in 0.264s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc06bc-de45-403b-b64d-c588fb866c14]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ddd2c-57eb-43a0-af12-5a57518281fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3227f297-c92d-405f-a5af-277bbd122407', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933dc951-8341-497a-a237-7962f0b24677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:18 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Volume volume-3227f297-c92d-405f-a5af-277bbd122407 (3227f297-c92d-405f-a5af-277bbd122407): created successfully Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933dc951-8341-497a-a237-7962f0b24677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (a6a3fb87-94f4-4673-a1cf-125bfe822058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-a85b80ff-8626-4882-b89a-a46a5bfb1eea tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:43:18 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 Nov 05 08:43:18 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:18 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" returned: 0 in 0.361s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c Nov 05 08:43:18 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:18 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:18 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c Nov 05 08:43:18 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:19 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8.c76f8e70-356a-4e2d-b49c-6523088dce1c" returned: 0 in 0.246s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-c76f8e70-356a-4e2d-b49c-6523088dce1c" released by "_delete_snapshot" :: held 1.402s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" released by "delete_snapshot" :: held 1.426s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Created reservations ['856d37d1-f336-4841-912b-7a8bf7289d74', '0c572aaa-c0eb-4e7e-b7fe-c3d2c14ba596', '36f36d47-34ed-4608-81c8-1ccc92254fdc', '2e486137-488e-47d8-acf6-176e9f39992b'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:19 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Delete snapshot completed successfully. Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-b73120dc-c85c-4496-bd57-121ff29289e1 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-c76f8e70-356a-4e2d-b49c-6523088dce1c-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Creating offline snapshot ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 of volume 3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95bad0-01f6-4a75-a8a2-bdc75c82cf45]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:19 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 Nov 05 08:43:19 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:19 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:20 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407" returned: 0 in 0.422s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:20 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 1G Nov 05 08:43:20 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[647fa757-c82c-4b8c-a388-8ee2fc76fa81]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 Nov 05 08:43:20 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 1G" returned: 0 in 0.405s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3227f297-c92d-405f-a5af-277bbd122407 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3227f297-c92d-405f-a5af-277bbd122407 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 Nov 05 08:43:20 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" returned: 0 in 0.389s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8 Nov 05 08:43:20 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3227f297-c92d-405f-a5af-277bbd122407 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" returned: 0 in 0.290s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:20 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 is being set with open permissions: ugo+rw Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" returned: 0 in 0.256s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:20 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 Nov 05 08:43:20 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-quobyte-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8" released by "delete_volume" :: held 0.708s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Created reservations ['84528288-5fd8-40fd-a67a-baba746d0a10', 'f25c275d-b7e4-445a-b540-115e225b6fdb', '250e5a71-4168-414d-8868-37aa5b409cc9', '0d27df6d-cd6f-4ef3-a168-677426391d86'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:20 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:20 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:20 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:20 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" returned: 0 in 0.258s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:21 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info Nov 05 08:43:21 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:21 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Deleted volume successfully. Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c18a54d8-faf8-4db9-ab9d-3f1efe47d071 tempest-ProjectReaderTests-1788288151 None] Lock "cinder-add5d7b4-ba36-4d2e-bbda-099b7d0e13a8-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:21 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info" returned: 0 in 0.268s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info is being set with open permissions: ugo+rw Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:21 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info Nov 05 08:43:21 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:21 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.info" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:21 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-56a2166e-3064-4ebe-a9eb-8d9cb20dcdb6 tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 of volume 3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9fce69-72c4-4ea7-84e8-38928b447e91]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:21 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:22 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 Nov 05 08:43:22 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:22 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" returned: 0 in 0.432s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3227f297-c92d-405f-a5af-277bbd122407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cfab85-fd09-433a-adcb-5dd4d8b3df85]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:22 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 Nov 05 08:43:22 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:22 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407" returned: 0 in 0.453s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:22 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:22 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 Nov 05 08:43:22 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:23 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" returned: 0 in 0.341s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:23 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049 Nov 05 08:43:23 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:23 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407.ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" returned: 0 in 0.252s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049" released by "_delete_snapshot" :: held 1.588s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" released by "delete_snapshot" :: held 1.620s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Created reservations ['9c26d642-5150-4379-b54b-332000210c24', 'f1396936-93b1-4e32-9c6a-bf749cab833d', '5a6f53e2-6645-4d1d-8fa7-79126649726b', '16120ea8-9c2e-4620-b174-a160653a5a61'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:23 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-ed772596-6c18-4b75-9040-a65d9f22025e tempest-ProjectMemberTests-78095360 None] Lock "cinder-ada4e2f8-2a0c-4b1b-a314-1c275a8f7049-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-3227f297-c92d-405f-a5af-277bbd122407-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:23 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-3227f297-c92d-405f-a5af-277bbd122407-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d14dad-cea1-4e87-a815-49d9308abfd5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:24 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 Nov 05 08:43:24 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:24 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407" returned: 0 in 0.410s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:24 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407 Nov 05 08:43:24 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:24 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-3227f297-c92d-405f-a5af-277bbd122407" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-3227f297-c92d-405f-a5af-277bbd122407" released by "delete_volume" :: held 0.742s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Created reservations ['6fc5e3dc-f7d2-4b19-b3f8-614d0f907768', '3f95db6e-5b5d-473c-b31c-5037abafc580', '85ddf71e-081c-45f6-8773-599d70d97790', 'c80e5038-dd41-4d2e-87b8-ac416975f4bb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:24 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:24 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:24 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:25 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:25 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-1684c926-bd39-4f31-ac59-511362b54af9 tempest-ProjectMemberTests-78095360 None] Lock "cinder-3227f297-c92d-405f-a5af-277bbd122407-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (2bc3a547-2e73-45e6-bdeb-bf3b314a4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cf60cd-ba4f-49ba-9207-2871fcf91535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cf60cd-ba4f-49ba-9207-2871fcf91535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692622558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcb889b-60d8-4bb6-9e93-f69fd4426b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:25Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4cf0d0-f1c3-451c-8424-33b370d8a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4cf0d0-f1c3-451c-8424-33b370d8a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935b9687-09cd-45f8-b702-d80e78616e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935b9687-09cd-45f8-b702-d80e78616e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcb889b-60d8-4bb6-9e93-f69fd4426b8c', 'volume_name': 'volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701d564-3abb-492f-bcd2-1475a080d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701d564-3abb-492f-bcd2-1475a080d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59498bac-43aa-4e7c-926b-0c7624a9c7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:25 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Volume 9fcb889b-60d8-4bb6-9e93-f69fd4426b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c', 'volume_size': 1} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692622558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcb889b-60d8-4bb6-9e93-f69fd4426b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a0f9c7c214a78a9b3793eba1a6547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:25Z,use_quota=True,user_id='fad34d748296443abb5c711c38bd7117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Creating volume 9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:25 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:25 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:25 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c 1073741824 Nov 05 08:43:25 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:26 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c 1073741824" returned: 0 in 0.453s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:26 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c Nov 05 08:43:26 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:26 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59498bac-43aa-4e7c-926b-0c7624a9c7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58230db3-e062-4e2e-ab48-415bd2f42e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:26 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Volume volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c (9fcb889b-60d8-4bb6-9e93-f69fd4426b8c): created successfully Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58230db3-e062-4e2e-ab48-415bd2f42e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Flow 'volume_create_manager' (2bc3a547-2e73-45e6-bdeb-bf3b314a4209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:26 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-090139f0-7c32-4b3b-a797-3078aef71540 tempest-ProjectMemberTests-78095360 None] Created volume successfully. Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Creating offline snapshot dac8fd39-da60-4b53-84ce-865086df158f of volume 9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b14450-6ac5-46e3-8b3e-622762a23962]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:26 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:26 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c Nov 05 08:43:26 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:27 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" returned: 0 in 0.358s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:27 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f 1G Nov 05 08:43:27 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:27 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f 1G" returned: 0 in 0.430s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:27 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f Nov 05 08:43:27 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:27 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f" returned: 0 in 0.323s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:27 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f is being set with open permissions: ugo+rw Nov 05 08:43:27 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:27 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f Nov 05 08:43:27 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:28 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f" returned: 0 in 0.257s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:28 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info Nov 05 08:43:28 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:28 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info" returned: 0 in 0.276s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:28 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info is being set with open permissions: ugo+rw Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:28 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info Nov 05 08:43:28 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:28 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.info" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:28 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-21865aff-4277-445f-983c-56492907cecd tempest-ProjectMemberTests-78095360 None] Create snapshot completed successfully Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-dac8fd39-da60-4b53-84ce-865086df158f-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-dac8fd39-da60-4b53-84ce-865086df158f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-dac8fd39-da60-4b53-84ce-865086df158f" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-dac8fd39-da60-4b53-84ce-865086df158f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:28 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Deleting offline snapshot dac8fd39-da60-4b53-84ce-865086df158f of volume 9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] snapshot_file for this snap is: volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac72dc-b7aa-42e4-8350-d2127d8bda0e]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:29 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f Nov 05 08:43:29 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:29 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f" returned: 0 in 0.386s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb4dfc-9ead-41f4-9a94-9e3f30c3bd1c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:29 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c Nov 05 08:43:29 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:29 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" returned: 0 in 0.377s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:29 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:29 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f Nov 05 08:43:29 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:30 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f" returned: 0 in 0.369s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:30 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f Nov 05 08:43:30 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:30 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c.dac8fd39-da60-4b53-84ce-865086df158f" returned: 0 in 0.278s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-dac8fd39-da60-4b53-84ce-865086df158f" released by "_delete_snapshot" :: held 1.514s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" released by "delete_snapshot" :: held 1.537s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Created reservations ['0096fc86-fa49-401d-8525-85e13dfe7b60', '50bd2827-4073-4c96-b650-d70189ea4a85', '55658f66-ff66-4395-a474-e0c3d69d3b75', '4a2f05fd-93d1-4845-84e8-887672324f26'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:30 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Delete snapshot completed successfully. Nov 05 08:43:30 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-66b0165a-ab4a-42f5-99e4-9c503dcbd54d tempest-ProjectMemberTests-78095360 None] Lock "cinder-dac8fd39-da60-4b53-84ce-865086df158f-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "cinder-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Acquiring lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10f7bb-02d2-4a31-9182-e571bd27b122]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:31 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c Nov 05 08:43:31 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:31 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" returned: 0 in 0.388s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:31 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c Nov 05 08:43:31 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:31 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "cinder-quobyte-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c" released by "delete_volume" :: held 0.722s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:31 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Created reservations ['470b2c7c-749c-4c87-aa1e-7de63a4e7450', '89bb55c2-5335-4b51-82a4-c2392e19970d', '43ede1c5-ddbe-4105-9209-08767467c7a3', '37164cc0-b626-489f-a675-cc2add5fd4e6'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:32 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:32 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:32 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.261s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:32 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Deleted volume successfully. Nov 05 08:43:32 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-f9d9e91d-65a1-4d30-bcea-b600c816bcd5 tempest-ProjectMemberTests-78095360 None] Lock "cinder-9fcb889b-60d8-4bb6-9e93-f69fd4426b8c-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=178,cinder:INSERT=57,cinder:UPDATE=226,cinder:DELETE=15 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:UPDATE=223,cinder:SELECT=165,cinder:INSERT=66,cinder:DELETE=22 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (00fffe4c-acc5-41a7-9f96-42ca7a2c0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dec05a2-bb04-4532-8a7c-042d58bb3534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dec05a2-bb04-4532-8a7c-042d58bb3534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532209018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6887036-7a03-45a8-b7c5-f5ecfc5d59ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:42Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9e319c-a10c-434d-b984-2b075c650146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9e319c-a10c-434d-b984-2b075c650146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc3f8fc-b49e-433d-8403-94be027f0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc3f8fc-b49e-433d-8403-94be027f0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6887036-7a03-45a8-b7c5-f5ecfc5d59ad', 'volume_name': 'volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8109e3c-e0e5-4e76-92c1-e3b4a2a9dd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8109e3c-e0e5-4e76-92c1-e3b4a2a9dd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becaa21a-f684-4502-b7ee-376967b86316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:42 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Volume e6887036-7a03-45a8-b7c5-f5ecfc5d59ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad', 'volume_size': 1} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-532209018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6887036-7a03-45a8-b7c5-f5ecfc5d59ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:42Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Creating volume e6887036-7a03-45a8-b7c5-f5ecfc5d59ad {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:42 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:42 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad 1073741824 Nov 05 08:43:42 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:42 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad 1073741824" returned: 0 in 0.472s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:42 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:42 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad Nov 05 08:43:42 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:43 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" returned: 0 in 0.262s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becaa21a-f684-4502-b7ee-376967b86316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fce2dc-d2d2-4b83-a4b9-c44319af5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:43 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Volume volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad (e6887036-7a03-45a8-b7c5-f5ecfc5d59ad): created successfully Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fce2dc-d2d2-4b83-a4b9-c44319af5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (00fffe4c-acc5-41a7-9f96-42ca7a2c0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:43 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-bce5a184-29fb-4cd8-9084-b8e422463356 tempest-ProjectReaderTests-1655461117 None] Created volume successfully. Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-quobyte-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" acquired by "delete_volume" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0eeff-80d0-4f9c-9800-d826247feba5]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:43 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:43 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad Nov 05 08:43:43 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:44 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" returned: 0 in 0.381s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:44 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad Nov 05 08:43:44 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:44 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" returned: 0 in 0.259s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad" released by "delete_volume" :: held 0.689s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Created reservations ['98c36da0-e3ef-4cb4-af2e-d4a5b29dde43', 'f7098af8-44e6-4a5c-bbc1-941a2230dbac', '44f1bfe9-0d67-4f6a-94b8-7cb023c75afe', '0c453909-f70b-484a-b081-d4e1eb3f259f'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:44 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:44 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:44 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.253s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:44 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Deleted volume successfully. Nov 05 08:43:44 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-624d9c0a-c00c-4fb0-b0af-22988e3f79a0 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-e6887036-7a03-45a8-b7c5-f5ecfc5d59ad-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (27dd006f-005b-4184-a619-8bd20a517cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52dab97-68ee-46b4-b484-8876cc17962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52dab97-68ee-46b4-b484-8876cc17962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000836334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca57d02-322d-408d-b4a3-25e4576aeb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:45Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be6abf4-ef70-4798-bd6b-5e5e4e8622a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be6abf4-ef70-4798-bd6b-5e5e4e8622a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de8f26c-79ee-4f1c-b747-efe1defc42f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de8f26c-79ee-4f1c-b747-efe1defc42f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca57d02-322d-408d-b4a3-25e4576aeb50', 'volume_name': 'volume-1ca57d02-322d-408d-b4a3-25e4576aeb50', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5994d55b-9f44-42f1-bae9-79cce9e9327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5994d55b-9f44-42f1-bae9-79cce9e9327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb07c32-51d4-4e17-9086-990b82aaf057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:45 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Volume 1ca57d02-322d-408d-b4a3-25e4576aeb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca57d02-322d-408d-b4a3-25e4576aeb50', 'volume_size': 1} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000836334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca57d02-322d-408d-b4a3-25e4576aeb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:45Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Creating volume 1ca57d02-322d-408d-b4a3-25e4576aeb50 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:45 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:45 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 1073741824 Nov 05 08:43:45 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:45 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 1073741824" returned: 0 in 0.503s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:45 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:45 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 Nov 05 08:43:45 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:46 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50" returned: 0 in 0.248s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb07c32-51d4-4e17-9086-990b82aaf057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca57d02-322d-408d-b4a3-25e4576aeb50', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026d88ab-9798-4e83-b601-563fcc84baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:46 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Volume volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 (1ca57d02-322d-408d-b4a3-25e4576aeb50): created successfully Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026d88ab-9798-4e83-b601-563fcc84baad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:46 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (27dd006f-005b-4184-a619-8bd20a517cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:46 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-de8b481b-4fee-48b8-ac7c-db10a0293534 tempest-ProjectReaderTests-1655461117 None] Created volume successfully. Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-1ca57d02-322d-408d-b4a3-25e4576aeb50-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-1ca57d02-322d-408d-b4a3-25e4576aeb50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-quobyte-1ca57d02-322d-408d-b4a3-25e4576aeb50" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-1ca57d02-322d-408d-b4a3-25e4576aeb50" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[661aea6f-0bed-40d3-b2b0-28412315f39f]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:47 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 Nov 05 08:43:47 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:47 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50" returned: 0 in 0.413s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:47 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:47 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50 Nov 05 08:43:47 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:48 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-1ca57d02-322d-408d-b4a3-25e4576aeb50" returned: 0 in 0.280s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-1ca57d02-322d-408d-b4a3-25e4576aeb50" released by "delete_volume" :: held 0.748s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Created reservations ['71240fab-ec32-4390-a535-71686dadc086', '2be99d4b-abff-4aaa-9816-9cdc43825bce', '19d32d76-93f9-47e4-baea-a0e06d1d1097', 'c7cdb331-f7e0-4cd9-9f2d-d56af1569ecb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:48 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:48 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:48 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.315s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:48 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Deleted volume successfully. Nov 05 08:43:48 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d1b581da-7530-4378-a1d9-3cb7d1c132a4 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-1ca57d02-322d-408d-b4a3-25e4576aeb50-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (b6644bde-08ed-4fcd-9e34-d4ad5819ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7486879-aa3d-4ba1-836a-6bce4c45b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7486879-aa3d-4ba1-836a-6bce4c45b68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117383891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c63fc8e-5d89-4346-8c26-f06ee87f4e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:49Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3332c7aa-3693-49f2-b333-34a37292793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3332c7aa-3693-49f2-b333-34a37292793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c158543-77b6-40a6-97d8-f14a9929f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c158543-77b6-40a6-97d8-f14a9929f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c63fc8e-5d89-4346-8c26-f06ee87f4e35', 'volume_name': 'volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ff0ac3-c0e2-4138-9255-51717655dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ff0ac3-c0e2-4138-9255-51717655dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de963c53-87a9-4063-8169-b95d90cfdfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:49 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Volume 4c63fc8e-5d89-4346-8c26-f06ee87f4e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35', 'volume_size': 1} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117383891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c63fc8e-5d89-4346-8c26-f06ee87f4e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:49Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Creating volume 4c63fc8e-5d89-4346-8c26-f06ee87f4e35 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:49 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:49 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 1073741824 Nov 05 08:43:49 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:49 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 1073741824" returned: 0 in 0.507s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:49 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 Nov 05 08:43:49 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:49 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" returned: 0 in 0.266s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de963c53-87a9-4063-8169-b95d90cfdfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:49 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed50184-8b65-42ef-981a-bc5b64a2efab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:50 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Volume volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 (4c63fc8e-5d89-4346-8c26-f06ee87f4e35): created successfully Nov 05 08:43:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed50184-8b65-42ef-981a-bc5b64a2efab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:50 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (b6644bde-08ed-4fcd-9e34-d4ad5819ba55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:50 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d21c62fa-2561-431f-9bb5-81293a4299a8 tempest-ProjectReaderTests-1655461117 None] Created volume successfully. Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-4c63fc8e-5d89-4346-8c26-f06ee87f4e35-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-4c63fc8e-5d89-4346-8c26-f06ee87f4e35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-quobyte-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc433928-c92d-42ab-93d3-6fbb38ae5bc3]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:51 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 Nov 05 08:43:51 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:51 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:51 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35 Nov 05 08:43:51 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:51 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" returned: 0 in 0.263s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:51 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-4c63fc8e-5d89-4346-8c26-f06ee87f4e35" released by "delete_volume" :: held 0.708s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Created reservations ['0e1ac473-d42c-4918-8611-f141d7bd17da', 'c5fef114-6a06-406a-aedd-746756f96ae2', 'acc67ff0-6ddd-4ab1-9013-3e4b8bae29f7', '3eb193a8-d338-4e7c-89f1-c8b5b4e220a1'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:52 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:52 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:52 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.306s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:52 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Deleted volume successfully. Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-5678d17a-59d0-4fab-accb-1c51cd233758 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-4c63fc8e-5d89-4346-8c26-f06ee87f4e35-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (415e1644-83d5-4a89-8d09-005051b43580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7729d-51da-456e-9dd6-901d6a686233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7729d-51da-456e-9dd6-901d6a686233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528456324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67cf07c-629b-4fa2-8c54-9ab40d18bc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:53Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1d34bd-f2e9-4469-ae66-e1c3856bd7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1d34bd-f2e9-4469-ae66-e1c3856bd7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e779abd2-c967-4c68-adeb-d65cf589b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e779abd2-c967-4c68-adeb-d65cf589b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67cf07c-629b-4fa2-8c54-9ab40d18bc16', 'volume_name': 'volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b4a80d-b6f5-4302-b3b6-d2389d909a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b4a80d-b6f5-4302-b3b6-d2389d909a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8970ed73-aa5b-4478-b93f-302ecef7a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:52 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Volume c67cf07c-629b-4fa2-8c54-9ab40d18bc16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16', 'volume_size': 1} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528456324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67cf07c-629b-4fa2-8c54-9ab40d18bc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8a081d28d4e36813fe9a20b811d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:43:53Z,use_quota=True,user_id='a2a7fae672e64ba8886e74e6c8e1e01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Creating volume c67cf07c-629b-4fa2-8c54-9ab40d18bc16 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:43:52 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:43:52 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:52 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 1073741824 Nov 05 08:43:52 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:53 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 1073741824" returned: 0 in 0.473s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:53 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 Nov 05 08:43:53 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:53 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" returned: 0 in 0.241s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8970ed73-aa5b-4478-b93f-302ecef7a83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3f690c-47bc-47d3-9e0e-cbde35f0c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:43:53 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Volume volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 (c67cf07c-629b-4fa2-8c54-9ab40d18bc16): created successfully Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3f690c-47bc-47d3-9e0e-cbde35f0c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Flow 'volume_create_manager' (415e1644-83d5-4a89-8d09-005051b43580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:43:53 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-9de242ef-c7c2-4f44-9f17-e2214577c4c4 tempest-ProjectReaderTests-1655461117 None] Created volume successfully. Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-c67cf07c-629b-4fa2-8c54-9ab40d18bc16-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-c67cf07c-629b-4fa2-8c54-9ab40d18bc16-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "cinder-quobyte-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:43:53 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117822e-ee8e-4119-9ece-6815a3a85f42]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:54 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 Nov 05 08:43:54 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:54 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" returned: 0 in 0.420s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:54 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16 Nov 05 08:43:54 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:54 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-quobyte-c67cf07c-629b-4fa2-8c54-9ab40d18bc16" released by "delete_volume" :: held 0.716s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Created reservations ['e0884478-a164-41e4-a8ab-478c52557c72', 'c013c45a-f0e1-4b57-8448-85355f3b20f9', 'f7dd2c00-027e-476a-b761-b304423db54b', 'e2e05a4d-11a0-412e-92e4-215728e9cdeb'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:43:54 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:43:54 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:43:54 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:43:55 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 05 08:43:55 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.270s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:43:55 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:43:55 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Deleted volume successfully. Nov 05 08:43:55 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-7f6ad693-1e4d-486f-afd8-d11029915009 tempest-ProjectReaderTests-1655461117 None] Lock "cinder-c67cf07c-629b-4fa2-8c54-9ab40d18bc16-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Flow 'volume_create_manager' (412f35df-6739-497e-8977-5457ba70f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a6e1b5-c25d-4c7a-801b-55a6532662d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a6e1b5-c25d-4c7a-801b-55a6532662d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1212176264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53d9ba9-0d99-4d5d-817f-46cc38f0fe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171f87a559aa4c21a2b3ed90d257c49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:02Z,use_quota=True,user_id='e4204f30798341af8b7add67bfe92184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711cac1b-85d6-40e5-bcc9-08c3def72502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711cac1b-85d6-40e5-bcc9-08c3def72502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861b7ef8-9263-4aea-b083-51878ba84c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861b7ef8-9263-4aea-b083-51878ba84c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53d9ba9-0d99-4d5d-817f-46cc38f0fe30', 'volume_name': 'volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fb1f1d-bc71-4217-8a1d-85040a532a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fb1f1d-bc71-4217-8a1d-85040a532a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feec607f-63ea-43a9-a9ae-b11dfa5b903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:02 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Volume e53d9ba9-0d99-4d5d-817f-46cc38f0fe30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30', 'volume_size': 1} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1212176264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53d9ba9-0d99-4d5d-817f-46cc38f0fe30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171f87a559aa4c21a2b3ed90d257c49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:02Z,use_quota=True,user_id='e4204f30798341af8b7add67bfe92184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)}" {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Creating volume e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:44:02 devstack cinder-volume[87092]: INFO cinder.volume.drivers.remotefs [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] casted to osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 1073741824 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 1073741824 Nov 05 08:44:02 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:02 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 1073741824" returned: 0 in 0.397s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:02 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:02 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:02 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:03 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'} {{(pid=87092) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feec607f-63ea-43a9-a9ae-b11dfa5b903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30', 'volume_size': 1}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f92f65d-4b2e-41a5-9c4a-7c550b6500bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:03 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Volume volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 (e53d9ba9-0d99-4d5d-817f-46cc38f0fe30): created successfully Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f92f65d-4b2e-41a5-9c4a-7c550b6500bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Flow 'volume_create_manager' (412f35df-6739-497e-8977-5457ba70f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:03 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-ce84e07c-5c93-48e1-b3c3-4806d118d983 tempest-SnapshotDependencyTests-140673941 None] Created volume successfully. Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Creating offline snapshot 299b0894-69de-4456-91e6-f14284579eef of volume e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f7b0df-e92e-437b-b713-1265bb1a79a7]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:03 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:03 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:03 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef 1G {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef 1G Nov 05 08:44:04 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef 1G" returned: 0 in 0.396s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:04 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 -F qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.283s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef is being set with open permissions: ugo+rw Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:04 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:04 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:04 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.243s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:04 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:05 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info Nov 05 08:44:05 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:05 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info" returned: 0 in 0.244s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:05 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info is being set with open permissions: ugo+rw Nov 05 08:44:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:05 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info Nov 05 08:44:05 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:05 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.info" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:05 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:05 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-1e8d35d7-7f68-4acb-a6f5-3923428b5093 tempest-SnapshotDependencyTests-140673941 None] Create snapshot completed successfully Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87092) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Flow 'volume_create_manager' (9628036e-7dff-4dcb-8d21-3e0747dbd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af7bdae-a01f-45f3-ad5b-30be66e3bca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af7bdae-a01f-45f3-ad5b-30be66e3bca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T07:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d9b04-5d35-4108-b620-45e9ce5f89c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171f87a559aa4c21a2b3ed90d257c49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T07:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=299b0894-69de-4456-91e6-f14284579eef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T07:44:06Z,use_quota=True,user_id='e4204f30798341af8b7add67bfe92184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c68c8f5-3904-46d6-ae9c-175c9882e764),volume_type_id=8c68c8f5-3904-46d6-ae9c-175c9882e764)' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e8082f-0adf-40aa-8616-17d4b785e614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e8082f-0adf-40aa-8616-17d4b785e614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d850079-35e7-49e8-8563-0075a93ccbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d850079-35e7-49e8-8563-0075a93ccbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '626d9b04-5d35-4108-b620-45e9ce5f89c5', 'volume_name': 'volume-626d9b04-5d35-4108-b620-45e9ce5f89c5', 'volume_size': 1, 'snapshot_id': '299b0894-69de-4456-91e6-f14284579eef'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af53e24-cd9f-4d56-805b-f6b4d5123af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af53e24-cd9f-4d56-805b-f6b4d5123af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12aa081-1d63-4764-a0fe-8287e71b0dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:06 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Volume 626d9b04-5d35-4108-b620-45e9ce5f89c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-626d9b04-5d35-4108-b620-45e9ce5f89c5', 'volume_size': 1, 'snapshot_id': '299b0894-69de-4456-91e6-f14284579eef'} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef-626d9b04-5d35-4108-b620-45e9ce5f89c5" by "_create_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef-626d9b04-5d35-4108-b620-45e9ce5f89c5" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Creating volume 626d9b04-5d35-4108-b620-45e9ce5f89c5 from snapshot 299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Selected osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee as target Quobyte volume. {{(pid=87092) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" by "_copy_volume_from_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] snapshot: 299b0894-69de-4456-91e6-f14284579eef, volume: 626d9b04-5d35-4108-b620-45e9ce5f89c5, {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9378d6a-e562-4b01-b455-697e518f02ac]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:06 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:06 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:06 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.352s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[442bfc76-899d-428d-9c0d-5783b4e6c35c]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:06 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:06 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:06 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:07 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.372s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 08:44:07 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Creating direct copy from snapshot {{(pid=87092) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 08:44:07 devstack cinder-volume[87092]: DEBUG cinder.utils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Path /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 not found in is_blk_device check {{(pid=87092) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 08:44:07 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:07 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 Nov 05 08:44:07 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:13 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5" returned: 0 in 5.877s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.image.image_utils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Image conversion details: src /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 {{(pid=87092) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 08:44:13 devstack cinder-volume[87092]: INFO cinder.image.image_utils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Converted 1024.00 MB image at 174.21 MB/s Nov 05 08:44:13 devstack cinder-volume[87092]: WARNING cinder.volume.drivers.remotefs [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 is being set with open permissions: ugo+rw Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:13 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 Nov 05 08:44:13 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:13 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" released by "_copy_volume_from_snapshot" :: held 6.930s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef-626d9b04-5d35-4108-b620-45e9ce5f89c5" released by "_create_volume_from_snapshot" :: held 6.995s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.013s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12aa081-1d63-4764-a0fe-8287e71b0dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626d9b04-5d35-4108-b620-45e9ce5f89c5', 'volume_size': 1, 'snapshot_id': '299b0894-69de-4456-91e6-f14284579eef'}' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2ec249-c7ae-4bd9-ae98-d315ea5ad03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 08:44:13 devstack cinder-volume[87092]: INFO cinder.volume.flows.manager.create_volume [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Volume volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 (626d9b04-5d35-4108-b620-45e9ce5f89c5): created successfully Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2ec249-c7ae-4bd9-ae98-d315ea5ad03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87092) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Flow 'volume_create_manager' (9628036e-7dff-4dcb-8d21-3e0747dbd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87092) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 08:44:13 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-d2c04a6a-de58-442a-9947-bd3dfd1f166d tempest-SnapshotDependencyTests-140673941 None] Created volume successfully. Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-299b0894-69de-4456-91e6-f14284579eef-delete_snapshot" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-299b0894-69de-4456-91e6-f14284579eef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" by "delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef" by "_delete_snapshot" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Deleting offline snapshot 299b0894-69de-4456-91e6-f14284579eef of volume e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] snapshot_file for this snap is: volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a44856-f9e8-4ad0-8c73-4c18c420dd9d]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:13 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:14 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:14 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:14 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.340s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.remotefs [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87092) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd836145-37c5-4547-a816-8f6d7f0b4857]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:14 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:14 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:14 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.517s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:14 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:14 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:14 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:15 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.320s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:15 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef Nov 05 08:44:15 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:15 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30.299b0894-69de-4456-91e6-f14284579eef" returned: 0 in 0.250s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-299b0894-69de-4456-91e6-f14284579eef" released by "_delete_snapshot" :: held 1.523s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" released by "delete_snapshot" :: held 1.544s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Created reservations ['20841a45-712a-4213-aa57-04d9a8c57b0d', '4a3142c5-eceb-433c-a10b-3535528abf0e', '3b51404c-fc75-4537-a23f-bb7415585451', 'b324123e-41b1-4215-8f3e-bf4fe513dabf'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:15 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Delete snapshot completed successfully. Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-c28f713a-1b4e-4ac7-96f6-dcc6249f4d03 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-299b0894-69de-4456-91e6-f14284579eef-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:15 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" acquired by "delete_volume" :: waited 0.017s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dceb2d-bc04-4477-b494-f5de65116a87]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:16 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:16 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:16 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.354s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:16 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30 Nov 05 08:44:16 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:16 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" returned: 0 in 0.249s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30" released by "delete_volume" :: held 0.661s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Created reservations ['463bf57b-b3b4-44d5-a1c8-a150f3257faa', '82f9b9f8-71e5-4680-acc5-7e6dcdc00b8b', 'defb814c-d910-4f24-843d-c71581969b86', '5afde3e1-3fed-44a7-b651-6fb0913b0da3'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:16 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:16 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:44:16 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:17 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.245s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:44:17 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Deleted volume successfully. Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-53068f40-876e-49b0-8b0d-5213f78621a9 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-e53d9ba9-0d99-4d5d-817f-46cc38f0fe30-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-626d9b04-5d35-4108-b620-45e9ce5f89c5-delete_volume" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-626d9b04-5d35-4108-b620-45e9ce5f89c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" by "delete_volume" {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87092) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo.privsep.daemon [-] privsep: reply[176237aa-8cf0-4e03-8ae2-7fc42f6069c6]: (4, 'qcow2') {{(pid=88368) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:17 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 Nov 05 08:44:17 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:17 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5" returned: 0 in 0.350s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:17 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5 Nov 05 08:44:17 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:17 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7/volume-626d9b04-5d35-4108-b620-45e9ce5f89c5" returned: 0 in 0.237s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-quobyte-626d9b04-5d35-4108-b620-45e9ce5f89c5" released by "delete_volume" :: held 0.634s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.quota [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Created reservations ['f73b9779-0803-4a3d-99a8-95cd85105671', 'b07dbaa9-455d-430c-a189-34c3c895b80f', '9ef20db6-6f9f-4303-b80e-ccc9c3d7bab7', '930d597d-29b3-4c5e-9a9a-c8178812bc1d'] {{(pid=87092) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:17 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:17 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:44:17 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:18 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.240s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:44:18 devstack cinder-volume[87092]: INFO cinder.volume.manager [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Deleted volume successfully. Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.coordination [None req-01062159-16ff-4fea-b2e0-5f058c68eb14 tempest-SnapshotDependencyTests-140673941 None] Lock "cinder-626d9b04-5d35-4108-b620-45e9ce5f89c5-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87092) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee': None} {{(pid=87092) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.volume.drivers.quobyte [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d202351c-9736-40e4-b93b-6708f701e0ee'] {{(pid=87092) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.lockutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87092) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 08:44:18 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7 Nov 05 08:44:18 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 08:44:18 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_concurrency.processutils [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/16b535b00193b6373b3c841e10888eb7" returned: 0 in 0.251s {{(pid=87092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Notifying Schedulers of capabilities ... {{(pid=87092) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG oslo_service.periodic_task [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] Running periodic task VolumeManager._thread_info {{(pid=87092) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread count: 28 {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 08:44:18 devstack cinder-volume[87092]: DEBUG cinder.volume.manager [None req-cb5b38b3-937d-4db2-bbf8-5eae6ef83e2c None None] thread info: [<_MainThread(MainThread, started 124671665746048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87092) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 08:44:27 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=55,cinder:INSERT=18,cinder:UPDATE=74,cinder:DELETE=2 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 08:44:28 devstack cinder-volume[87092]: DEBUG dbcounter [-] [87092] Writing DB stats cinder:SELECT=51,cinder:UPDATE=72,cinder:DELETE=11,cinder:INSERT=17 {{(pid=87092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}